Sep 29 16:24:28 devstack cinder-volume[75438]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 16:24:28 devstack cinder-volume[75438]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 16:24:28 devstack cinder-volume[75438]: we strongly recommend against using it for new projects.
Sep 29 16:24:28 devstack cinder-volume[75438]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 16:24:28 devstack cinder-volume[75438]: framework.  For more detail see
Sep 29 16:24:28 devstack cinder-volume[75438]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 16:24:28 devstack cinder-volume[75438]:   import eventlet  # noqa
Sep 29 16:24:31 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:24:31 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:24:31 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:24:32 devstack cinder-volume[75438]: INFO dbcounter [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Registered counter for database cinder
Sep 29 16:24:32 devstack cinder-volume[75438]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75438) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG dbcounter [-] [75438] Writer thread running {{(pid=75438) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:24:33 devstack cinder-volume[75438]: INFO cinder.rpc [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 16:24:33 devstack cinder-volume[75438]: INFO cinder.rpc [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75438) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:24:33 devstack cinder-volume[75438]: INFO cinder.volume.manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Determined volume DB was empty at startup.
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG cinder.volume.manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75438) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 16:24:33 devstack cinder-volume[75438]: INFO cinder.volume.manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 16:24:33 devstack cinder-volume[75438]: WARNING stevedore.named [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 16:24:33 devstack cinder-volume[75438]: WARNING castellan.key_manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:24:33 devstack cinder-volume[75438]: WARNING cinder.keymgr.conf_key_mgr [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG cinder.volume.drivers.lvm [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75438) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG oslo_concurrency.processutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:33 devstack cinder-volume[75438]: DEBUG oslo_concurrency.processutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.547s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75438) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:24:34 devstack cinder-volume[75438]: INFO cinder.rpc [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 29 16:24:34 devstack cinder-volume[75438]: INFO cinder.rpc [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 29 16:24:34 devstack cinder-volume[75438]: WARNING stevedore.named [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 16:24:34 devstack cinder-volume[75438]: WARNING castellan.key_manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:24:34 devstack cinder-volume[75438]: INFO cinder.volume.manager [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75438) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:24:34 devstack cinder-volume[75438]: INFO oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Starting 1 workers
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Started child 75631 {{(pid=75438) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Full set of CONF: {{(pid=75438) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] ******************************************************************************** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Configuration options gathered from: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 16:24:34 devstack cinder-volume[75631]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] ================================================================================ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] allow_availability_zone_fallback = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] allow_compression_on_image_upload = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] allowed_direct_url_schemes     = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] api_rate_limit                 = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] auth_strategy                  = keystone {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] az_cache_duration              = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_availability_zone      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_host                   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_name                   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_stats_polling_interval = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backup_api_class               = cinder.backup.api.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backup_name_template           = backup-%s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backup_use_same_host           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backup_use_temp_snapshot       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] chap_password                  = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] chap_username                  =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_internal_tenant_project_id = 90f17d5417d04aa3996697327be52a75 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_internal_tenant_user_id = 1ffb5fbbff7046e09a54e1c00bba9ef0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cloned_volume_same_az          = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cluster                        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] compression_format             = gzip {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] config_dir                     = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] config_source                  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] control_exchange               = openstack {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] debug                          = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] default_availability_zone      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] default_group_type             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] default_volume_type            = lvmdriver-1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] disk_geometry                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_client_cert             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_client_cert_key         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_data_namespace          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_ssl_cert_path           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_ssl_cert_verify         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] driver_use_ssl                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] enable_force_upload            = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] enable_new_services            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] enable_unsupported_driver      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] enforce_multipath_for_image_xfer = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] filter_function                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_api_insecure            = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_api_ssl_compression     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_ca_certificates_file    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_num_retries             = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance_request_timeout         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] goodness_function              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] graceful_shutdown_timeout      = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] group_api_class                = cinder.group.api.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] host                           = devstack {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_compress_on_upload       = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_conversion_address_space_limit = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_conversion_cpu_limit     = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_conversion_disable       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_introspection_address_space_limit = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_introspection_cpu_limit  = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_upload_use_cinder_backend = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_upload_use_internal_tenant = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_volume_cache_enabled     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_volume_cache_max_count   = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] init_host_max_objects_retrieval = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iscsi_target_flags             =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iscsi_write_cache              = on {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iser_helper                    = tgtadm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iser_ip_address                = 192.168.122.131 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iser_port                      = 3260 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_color                      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_config_append              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_dir                        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_file                       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_options                    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_rotate_interval            = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_rotate_interval_type       = days {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] log_rotation_type              = none {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] max_age                        = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] max_logfile_count              = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] max_logfile_size_mb            = 200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] max_over_subscription_ratio    = 20.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] message_reap_interval          = 86400 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] message_ttl                    = 2592000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] monkey_patch                   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] monkey_patch_modules           = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] my_ip                          = 192.168.122.131 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] no_snapshot_gb_quota           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] num_iser_scan_tries            = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] num_shell_tries                = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] num_volume_device_scan_tries   = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] nvmeof_conn_info_version       = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] nvmet_ns_id                    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] nvmet_port_id                  = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_max_limit                = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_ext_list          = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_listen_port       = 8776 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_use_ssl           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] osapi_volume_workers           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] per_volume_size_limit          = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] periodic_fuzzy_delay           = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] periodic_interval              = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] public_endpoint                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] publish_errors                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_backup_gigabytes         = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_backups                  = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_gigabytes                = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_groups                   = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_snapshots                = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] quota_volumes                  = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] rate_limit_burst               = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] rate_limit_except_level        = CRITICAL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] rate_limit_interval            = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] reinit_driver_count            = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] replication_device             = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] report_discard_supported       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] report_interval                = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] reservation_clean_interval     = 86400 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] reservation_expire             = 86400 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] reserved_image_namespaces      = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] reserved_percentage            = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] rpc_response_timeout           = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] run_external_periodic_tasks    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] scst_target_driver             = iscsi {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] scst_target_iqn_name           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_down_time              = 720 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] shell_completion               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] snapshot_name_template         = snapshot-%s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] snapshot_same_host             = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] split_loggers                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] state_path                     = /opt/stack/data/cinder {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] storage_availability_zone      = nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] storage_protocol               = iSCSI {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] syslog_log_facility            = LOG_USER {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_helper                  = lioadm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_ip_address              = 192.168.122.131 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_port                    = 3260 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_protocol                = iscsi {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] target_secondary_ip_addresses  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] trace_flags                    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] transport_url                  = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] until_refresh                  = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_chap_auth                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_default_quota_class        = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_journal                    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_json                       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_multipath_for_image_xfer   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_stderr                     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] use_syslog                     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] verify_glance_signatures       = enabled {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_api_class               = cinder.volume.api.API {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_backend_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_clear                   = zero {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_clear_ionice            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_clear_size              = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_copy_bps_limit          = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_dd_blocksize            = 1M {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_name_template           = volume-%s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_service_inithost_offload = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volume_usage_audit_period      = month {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] zoning_mode                    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.auth_section = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.auth_type   = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.auth_version = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.cache       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.certfile    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.insecure    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.interface   = public {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.keyfile     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_password = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcache_username = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.region_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.service_type = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.backend                  = dogpile.cache.null {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.backend_argument         = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.backend_expiration_time  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.config_prefix            = cache.oslo {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.debug_cache_backend      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.enable_retry_client      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.enable_socket_keepalive  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack sudo[75689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.enabled                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.expiration_time          = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_dead_retry      = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack sudo[75689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_sasl_enabled    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.password                 = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.proxies                  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.redis_db                 = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.redis_server             = localhost:6379 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.retry_attempts           = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.retry_delay              = 0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.socket_keepalive_count   = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.socket_keepalive_idle    = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.socket_keepalive_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.socket_timeout           = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.tls_allowed_ciphers      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.tls_cafile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.tls_certfile             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.tls_enabled              = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.tls_keyfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cache.username                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] coordination.backend_url       = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.asyncio_connection    = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.asyncio_slave_connection = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.backend               = sqlalchemy {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.connection            = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.connection_debug      = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.connection_parameters =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.connection_recycle_time = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.connection_trace      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.db_inc_retry_interval = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.db_max_retries        = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.db_max_retry_interval = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.db_retry_interval     = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.max_overflow          = 50 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.max_pool_size         = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.max_retries           = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.pool_timeout          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.retry_interval        = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.slave_connection      = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.sqlite_synchronous    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.synchronous_reader    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] database.use_db_reconnect      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_tracing.insecure = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.connection_string     = messaging:// {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.enabled               = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.es_doc_type           = notification {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.es_scroll_size        = 10000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.es_scroll_time        = 2m {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.filter_error_trace    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.hmac_keys             = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.sentinel_service_name = mymaster {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.socket_timeout        = 0.1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.trace_requests        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler.trace_sqlalchemy      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler_jaeger.process_tags   = {} {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] profiler_otlp.service_name_prefix = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.policy_default_rule = default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.group          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.helper_command = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] privsep_osbrick.user           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.group         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.helper_command = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] cinder_sys_admin.user          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.auth_section      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.auth_type         = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.cafile            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.certfile          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.collect_timing    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.insecure          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.keyfile           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.send_service_user_token = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.split_loggers     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.timeout           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.tls_ciphers       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] service_user.tls_min_version   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.auth_section            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.auth_type               = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.collect_timing          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.region_name             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.split_loggers           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.timeout                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.tls_ciphers             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] glance.tls_min_version         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.backend_availability_zone = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.chap_password = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.chap_username =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.disk_geometry = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_client_cert = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_data_namespace = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.driver_use_ssl = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.extra_capabilities = {} {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.filter_function = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.goodness_function = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iscsi_target_flags =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iser_port     = 3260 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.lvm_share_target = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.lvm_type      = auto {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.replication_device = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.report_discard_supported = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_helper = tgtadm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_port   = 3260 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_protocol = iscsi {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.trace_flags   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.use_chap_auth = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_backend_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_clear  = zero {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_reports.file_event_handler = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_reports.log_dir           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.backend_host       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.chap_password      = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.chap_username      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.disk_geometry      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.filter_function    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.goodness_function  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iser_helper        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iser_port          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.lvm_type           = auto {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.replication_device = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.storage_protocol   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_ip_address  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_port        = 3260 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.trace_flags        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_clear       = zero {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] lvmdriver-1.volumes_dir        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_notifications.driver = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] key_manager.fixed_key          = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.barbican_api_version  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.barbican_endpoint     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.barbican_endpoint_type = public {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.barbican_region_name  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.cafile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.certfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.collect_timing        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.insecure              = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.keyfile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.number_of_retries     = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.retry_delay           = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.send_service_user_token = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.split_loggers         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.timeout               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.tls_ciphers           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.tls_min_version       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.verify_ssl            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican.verify_ssl_path       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.auth_section = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.auth_type = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.cafile   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.certfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.collect_timing = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.insecure = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.keyfile  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.split_loggers = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.timeout  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.tls_ciphers = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] barbican_service_user.tls_min_version = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.approle_role_id          = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.approle_secret_id        = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.auth_method              = approle {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.auth_path                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.kv_mountpoint            = secret {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.kv_path                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.kv_version               = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.namespace                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.root_token_id            = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.ssl_ca_crt_file          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.timeout                  = 60.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.token_file               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.token_role               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.use_ssl                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:24:34 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] ******************************************************************************** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 16:24:34 devstack sudo[75689]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:34 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:34 devstack sudo[75836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:34 devstack sudo[75836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:35 devstack sudo[75836]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:24:35 devstack cinder-volume[75631]: INFO cinder.brick.local_dev.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:35 devstack sudo[75921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:35 devstack sudo[75921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:35 devstack sudo[75921]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG cinder.brick.local_dev.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75631) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 29 16:24:35 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:35 devstack sudo[76005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:35 devstack sudo[76005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:36 devstack sudo[76005]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.591s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:36 devstack sudo[76238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:36 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:36 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:36 devstack sudo[76245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 29 16:24:36 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:36 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.404s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:36 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:36 devstack sudo[76329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:36 devstack sudo[76329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:37 devstack sudo[76329]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:37 devstack sudo[76338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:37 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:37 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:37 devstack sudo[76421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:37 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:37 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:37 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:37 devstack sudo[76424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:37 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:38 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:38 devstack sudo[76428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:38 devstack sudo[76428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:38 devstack sudo[76428]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:38 devstack cinder-volume[75631]: INFO cinder.volume.drivers.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:38 devstack sudo[76432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:38 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:38 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:24:38 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:38 devstack sudo[76441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:38 devstack sudo[76441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:39 devstack sudo[76441]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:39 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:39 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:39 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:39 devstack sudo[76447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:39 devstack sudo[76447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:39 devstack sudo[76447]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:39 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:39 devstack sudo[76451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:39 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:40 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:40 devstack cinder-volume[75631]: INFO cinder.volume.driver [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG cinder.volume.driver [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75631) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_db.sqlalchemy.engines [None req-1c561b32-547c-4337-9031-9e697aad731c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writer thread running {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG cinder.db.api [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Building query based on filter {{(pid=75631) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG cinder.image.image_utils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75631) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 16:24:40 devstack cinder-volume[75631]: INFO cinder.keymgr.migration [None req-8f529ce8-9de6-4483-b0ef-ebdc6c1be38e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:40 devstack sudo[76456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:40 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:40 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:40 devstack sudo[76459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:40 devstack sudo[76459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:40 devstack sudo[76459]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:40 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:40 devstack sudo[76463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:40 devstack sudo[76463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:41 devstack sudo[76463]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:41 devstack sudo[76466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:41 devstack sudo[76466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:41 devstack sudo[76466]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG cinder.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Notifying Schedulers of capabilities ... {{(pid=75631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:24:41 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Driver initialization completed successfully.
Sep 29 16:24:41 devstack cinder-volume[75631]: INFO cinder.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Initiating service 2 cleanup
Sep 29 16:24:41 devstack cinder-volume[75631]: INFO cinder.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Service 2 cleanup completed.
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG cinder.service [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Creating RPC server for service cinder-volume {{(pid=75631) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG cinder.service [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75631) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 16:24:41 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:41 devstack sudo[76471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:24:41 devstack sudo[76471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:41 devstack sudo[76471]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:41 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:41 devstack sudo[76474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:41 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:42 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:42 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:42 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:42 devstack sudo[76480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:24:42 devstack sudo[76480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:42 devstack sudo[76480]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:42 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:42 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:24:42 devstack sudo[76483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:24:42 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:24:42 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root
Sep 29 16:24:42 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-1c561b32-547c-4337-9031-9e697aad731c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:24:42 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-1c561b32-547c-4337-9031-9e697aad731c None None] Driver post RPC initialization completed successfully.
Sep 29 16:24:44 devstack cinder-volume[75438]: DEBUG dbcounter [-] [75438] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75438) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:24:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:24:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:25:04 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager._thread_info {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:25:04 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread count: 6 {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:25:04 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread info: [<_MainThread(MainThread, started 128731470651520)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128731358309376)>, <Thread(Thread-3 (stat_writer), started daemon 128731355864768)>, <Thread(Rabbit-heartbeat, started daemon 128731355352384)>, <Thread(Thread-5 (_runner), started daemon 128731355402048)>, <Thread(Thread-7 (_runner), started daemon 128731355553024)>] {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:26:04 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:26:04 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:26:04 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:26:04 devstack sudo[79493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:26:04 devstack sudo[79493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:26:05 devstack sudo[79493]: pam_unix(sudo:session): session closed for user root
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:26:05 devstack sudo[79672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:26:05 devstack sudo[79672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:26:05 devstack sudo[79672]: pam_unix(sudo:session): session closed for user root
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:26:05 devstack sudo[79843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:26:05 devstack sudo[79843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:26:05 devstack sudo[79843]: pam_unix(sudo:session): session closed for user root
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:26:05 devstack sudo[80015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:26:05 devstack sudo[80015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:26:05 devstack sudo[80015]: pam_unix(sudo:session): session closed for user root
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG cinder.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Notifying Schedulers of capabilities ... {{(pid=75631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager._thread_info {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread count: 6 {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:26:05 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread info: [<_MainThread(MainThread, started 128731470651520)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128731358309376)>, <Thread(Thread-3 (stat_writer), started daemon 128731355864768)>, <Thread(Rabbit-heartbeat, started daemon 128731355352384)>, <Thread(Thread-5 (_runner), started daemon 128731355402048)>, <Thread(Thread-7 (_runner), started daemon 128731355553024)>] {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:26:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:SELECT=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:26:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:UPDATE=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:27:04 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:27:04 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:27:04 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:27:04 devstack sudo[83334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:27:04 devstack sudo[83334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:27:05 devstack sudo[83334]: pam_unix(sudo:session): session closed for user root
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:27:05 devstack sudo[83346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:27:05 devstack sudo[83346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:27:05 devstack sudo[83346]: pam_unix(sudo:session): session closed for user root
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:27:05 devstack sudo[83364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:27:05 devstack sudo[83364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:27:05 devstack sudo[83364]: pam_unix(sudo:session): session closed for user root
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:27:05 devstack sudo[83369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:27:05 devstack sudo[83369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:27:05 devstack sudo[83369]: pam_unix(sudo:session): session closed for user root
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:27:05 devstack cinder-volume[75631]: DEBUG cinder.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Notifying Schedulers of capabilities ... {{(pid=75631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:28:04 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:28:04 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Updating volume stats {{(pid=75631) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 16:28:04 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:28:04 devstack sudo[84890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 16:28:04 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:28:04 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root
Sep 29 16:28:04 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:28:04 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:28:05 devstack sudo[84893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:28:05 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:28:05 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:28:05 devstack sudo[84900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 16:28:05 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:28:05 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:28:05 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 16:28:05 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:28:05 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG cinder.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Notifying Schedulers of capabilities ... {{(pid=75631) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG oslo_service.periodic_task [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] Running periodic task VolumeManager._thread_info {{(pid=75631) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread count: 6 {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:28:05 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-d5764dfa-2083-4913-9421-f1c60a86d659 None None] thread info: [<_MainThread(MainThread, started 128731470651520)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128731358309376)>, <Thread(Thread-3 (stat_writer), started daemon 128731355864768)>, <Thread(Rabbit-heartbeat, started daemon 128731355352384)>, <Thread(Thread-5 (_runner), started daemon 128731355402048)>, <Thread(Thread-7 (_runner), started daemon 128731355553024)>] {{(pid=75631) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:28:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:SELECT=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:28:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:UPDATE=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:28:54 devstack cinder-volume[75438]: INFO oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Caught SIGTERM, stopping children
Sep 29 16:28:54 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Acquiring lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:28:54 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Acquired lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:28:54 devstack cinder-volume[75438]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Releasing lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:28:54 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Stop services. {{(pid=75438) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 16:28:54 devstack cinder-volume[75438]: DEBUG oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Killing children. {{(pid=75438) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 16:28:54 devstack cinder-volume[75438]: INFO oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Waiting on 1 children to exit
Sep 29 16:28:56 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Acquiring lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:28:56 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Acquired lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:28:56 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Releasing lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:28:56 devstack cinder-volume[75631]: WARNING amqp [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 16:28:56 devstack cinder-volume[75631]: WARNING amqp [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 16:28:56 devstack cinder-volume[75438]: INFO oslo_service.backend._eventlet.service [None req-f1f85de3-c33e-4fff-988b-8ff78754ded5 None None] Child 75631 exited with status 0
Sep 29 16:28:56 devstack cinder-volume[85986]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 16:28:56 devstack cinder-volume[85986]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 16:28:56 devstack cinder-volume[85986]: we strongly recommend against using it for new projects.
Sep 29 16:28:56 devstack cinder-volume[85986]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 16:28:56 devstack cinder-volume[85986]: framework.  For more detail see
Sep 29 16:28:56 devstack cinder-volume[85986]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 16:28:56 devstack cinder-volume[85986]:   import eventlet  # noqa
Sep 29 16:28:58 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:28:58 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:28:58 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:28:59 devstack cinder-volume[85986]: INFO dbcounter [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Registered counter for database cinder
Sep 29 16:28:59 devstack cinder-volume[85986]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:28:59 devstack cinder-volume[85986]: DEBUG dbcounter [-] [85986] Writer thread running {{(pid=85986) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:28:59 devstack cinder-volume[85986]: INFO cinder.rpc [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 16:28:59 devstack cinder-volume[85986]: INFO cinder.rpc [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:00 devstack cinder-volume[85986]: INFO cinder.volume.manager [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Determined volume DB was empty at startup.
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG cinder.volume.manager [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85986) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 16:29:00 devstack cinder-volume[85986]: INFO cinder.volume.manager [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 16:29:00 devstack cinder-volume[85986]: WARNING stevedore.named [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 16:29:00 devstack cinder-volume[85986]: WARNING castellan.key_manager [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:29:00 devstack cinder-volume[85986]: WARNING cinder.keymgr.conf_key_mgr [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:29:00 devstack cinder-volume[85986]: INFO cinder.volume.manager [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85986) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:00 devstack cinder-volume[85986]: INFO oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Starting 1 workers
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Started child 86199 {{(pid=85986) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Full set of CONF: {{(pid=85986) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] ******************************************************************************** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Configuration options gathered from: {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] ================================================================================ {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] allow_availability_zone_fallback = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] allow_compression_on_image_upload = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] allowed_direct_url_schemes     = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] api_rate_limit                 = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] auth_strategy                  = keystone {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_availability_zone      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_host                   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_name                   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_stats_polling_interval = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backup_api_class               = cinder.backup.api.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backup_name_template           = backup-%s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backup_use_same_host           = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backup_use_temp_snapshot       = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] chap_password                  = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] chap_username                  =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_internal_tenant_project_id = 90f17d5417d04aa3996697327be52a75 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_internal_tenant_user_id = 1ffb5fbbff7046e09a54e1c00bba9ef0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cluster                        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] compression_format             = gzip {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] config_dir                     = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] config_source                  = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] control_exchange               = openstack {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] debug                          = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] default_availability_zone      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] default_group_type             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] default_volume_type            = QuobyteHD {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] disk_geometry                  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_client_cert             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_client_cert_key         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_data_namespace          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_ssl_cert_path           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_ssl_cert_verify         = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] driver_use_ssl                 = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] enable_new_services            = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] enable_unsupported_driver      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] enforce_multipath_for_image_xfer = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] filter_function                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_api_insecure            = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_api_ssl_compression     = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_ca_certificates_file    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_certfile                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_keyfile                 = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_num_retries             = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance_request_timeout         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] goodness_function              = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] graceful_shutdown_timeout      = 5 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] group_api_class                = cinder.group.api.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] host                           = devstack {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_compress_on_upload       = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_conversion_address_space_limit = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_conversion_cpu_limit     = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_conversion_disable       = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_introspection_address_space_limit = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_introspection_cpu_limit  = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_upload_use_cinder_backend = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_upload_use_internal_tenant = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_volume_cache_enabled     = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_volume_cache_max_count   = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] image_volume_cache_max_size_gb = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] init_host_max_objects_retrieval = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iscsi_target_flags             =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[86199]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iscsi_write_cache              = on {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iser_helper                    = tgtadm {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iser_ip_address                = 192.168.122.131 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iser_port                      = 3260 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_color                      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_config_append              = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_dir                        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_file                       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_options                    = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_rotate_interval            = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_rotate_interval_type       = days {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] log_rotation_type              = none {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] max_age                        = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] max_logfile_count              = 30 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] max_logfile_size_mb            = 200 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] max_over_subscription_ratio    = 20.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] message_reap_interval          = 86400 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] message_ttl                    = 2592000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] migration_create_volume_timeout_secs = 300 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] monkey_patch                   = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] monkey_patch_modules           = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] my_ip                          = 192.168.122.131 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] no_snapshot_gb_quota           = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] num_iser_scan_tries            = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] num_shell_tries                = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] num_volume_device_scan_tries   = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] nvmeof_conn_info_version       = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] nvmet_ns_id                    = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] nvmet_port_id                  = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_max_limit                = 1000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_ext_list          = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_listen_port       = 8776 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_use_ssl           = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] osapi_volume_workers           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] per_volume_size_limit          = -1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] periodic_fuzzy_delay           = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] periodic_interval              = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] public_endpoint                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] publish_errors                 = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_backup_gigabytes         = 1000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_backups                  = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_gigabytes                = 1000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_groups                   = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_snapshots                = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] quota_volumes                  = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] rate_limit_burst               = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] rate_limit_except_level        = CRITICAL {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] rate_limit_interval            = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] reinit_driver_count            = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] replication_device             = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] report_discard_supported       = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] report_interval                = 120 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] reservation_clean_interval     = 86400 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] reservation_expire             = 86400 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] reserved_image_namespaces      = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] reserved_percentage            = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] rpc_response_timeout           = 120 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] run_external_periodic_tasks    = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] scst_target_driver             = iscsi {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] scst_target_iqn_name           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_down_time              = 720 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] shell_completion               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] snapshot_name_template         = snapshot-%s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] split_loggers                  = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] state_path                     = /opt/stack/data/cinder {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] storage_availability_zone      = nova {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] storage_protocol               = iSCSI {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] syslog_log_facility            = LOG_USER {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_helper                  = lioadm {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_ip_address              = 192.168.122.131 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_port                    = 3260 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_protocol                = iscsi {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] target_secondary_ip_addresses  = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] trace_flags                    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] transport_url                  = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] until_refresh                  = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_chap_auth                  = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_default_quota_class        = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_journal                    = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_json                       = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_multipath_for_image_xfer   = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_stderr                     = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] use_syslog                     = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] verify_glance_signatures       = enabled {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_api_class               = cinder.volume.api.API {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_backend_name            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_clear                   = zero {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_clear_ionice            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_clear_size              = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_copy_bps_limit          = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_dd_blocksize            = 1M {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_name_template           = volume-%s {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_service_inithost_offload = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volume_usage_audit_period      = month {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.remotefs [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86199) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] zoning_mode                    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_concurrency.disable_process_locking = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.auth_section = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.auth_type   = password {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.auth_version = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.cache       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.certfile    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.include_service_catalog = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.insecure    = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.interface   = public {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.keyfile     = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_password = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcache_username = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.region_name = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.service_type = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.backend                  = dogpile.cache.null {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.backend_argument         = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.backend_expiration_time  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.config_prefix            = cache.oslo {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.debug_cache_backend      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.enable_retry_client      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.enable_socket_keepalive  = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.enabled                  = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.expiration_time          = 600 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.hashclient_retry_attempts = 2 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_dead_retry      = 300 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_sasl_enabled    = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.password                 = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.proxies                  = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.redis_db                 = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.redis_server             = localhost:6379 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.retry_attempts           = 2 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.retry_delay              = 0.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.socket_keepalive_count   = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.socket_keepalive_idle    = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.socket_keepalive_interval = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.socket_timeout           = 1.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.tls_allowed_ciphers      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.tls_cafile               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.tls_certfile             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.tls_enabled              = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.tls_keyfile              = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cache.username                 = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] coordination.backend_url       = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.asyncio_connection    = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.asyncio_slave_connection = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.backend               = sqlalchemy {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.connection            = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.connection_debug      = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.connection_parameters =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.connection_recycle_time = 3600 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.connection_trace      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.db_inc_retry_interval = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.db_max_retries        = 20 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.db_max_retry_interval = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.db_retry_interval     = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.max_overflow          = 50 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.max_pool_size         = 5 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.max_retries           = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.mysql_wsrep_sync_wait = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.pool_timeout          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.retry_interval        = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.slave_connection      = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.sqlite_synchronous    = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.synchronous_reader    = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] database.use_db_reconnect      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_tracing.insecure = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.connection_string     = messaging:// {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.enabled               = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.es_doc_type           = notification {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.es_scroll_size        = 10000 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.es_scroll_time        = 2m {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.filter_error_trace    = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.hmac_keys             = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.sentinel_service_name = mymaster {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.socket_timeout        = 0.1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.trace_requests        = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler.trace_sqlalchemy      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler_jaeger.process_tags   = {} {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler_jaeger.service_name_prefix = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] profiler_otlp.service_name_prefix = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.enforce_new_defaults = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.policy_default_rule = default {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.group          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.helper_command = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] privsep_osbrick.user           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.group         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.helper_command = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] cinder_sys_admin.user          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.auth_section      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.auth_type         = password {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.cafile            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.certfile          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.collect_timing    = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.insecure          = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.keyfile           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.send_service_user_token = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.split_loggers     = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.timeout           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.tls_ciphers       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] service_user.tls_min_version   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.auth_section            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.auth_type               = password {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.certfile                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86199) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.collect_timing          = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.insecure                = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.keyfile                 = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.region_name             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.split_loggers           = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: WARNING cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 16:29:00 devstack cinder-volume[86199]: WARNING cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.timeout                 = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.tls_ciphers             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Running cmd (subprocess): mount.quobyte {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] glance.tls_min_version         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.backend_availability_zone = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.chap_password = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.chap_username =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.disk_geometry = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_client_cert = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_client_cert_key = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_data_namespace = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.driver_use_ssl = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.extra_capabilities = {} {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.filter_function = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.goodness_function = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iscsi_target_flags =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iscsi_write_cache = on {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iser_port     = 3260 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_host      =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_login     = admin {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_mount_options = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_password  = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_private_key =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_share_path =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.num_shell_tries = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.quobyte_volume_url = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.replication_device = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.report_discard_supported = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.reserved_percentage = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_helper = tgtadm {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_port   = 3260 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_protocol = iscsi {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.trace_flags   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.unique_fqdn_network = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.use_chap_auth = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_backend_name = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_clear  = zero {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_clear_ionice = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_clear_size = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_reports.file_event_handler = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_reports.log_dir           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.backend_availability_zone = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.backend_host         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.chap_password        = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.chap_username        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.disk_geometry        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_client_cert   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_data_namespace = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.extra_capabilities   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.filter_function      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.goodness_function    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iser_helper          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iser_ip_address      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iser_port            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_host             = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_login            = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_mount_options    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_password         = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_private_key      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_share_path       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.num_shell_tries      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.replication_device   = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.report_discard_supported = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.reserved_percentage  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.scst_target_driver   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.storage_protocol     = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_helper        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_ip_address    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_port          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_prefix        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_protocol      = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack quobyte-client[86200]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 16:29:00 devstack quobyte-client[86200]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.trace_flags          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] CMD "mount.quobyte" returned: 1 in 0.123s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.use_chap_auth        = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_clear         = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_clear_size    = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] QuobyteHD.volumes_dir          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: INFO cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 ...
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 -c /etc/quobyte/client-cinder.cfg {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_notifications.driver = [] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_notifications.retry = -1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] key_manager.fixed_key          = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.barbican_api_version  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.barbican_endpoint     = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.barbican_endpoint_type = public {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.barbican_region_name  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.cafile                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.certfile              = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.collect_timing        = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.insecure              = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.keyfile               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 -c /etc/quobyte/client-cinder.cfg
Sep 29 16:29:00 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.number_of_retries     = 60 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.retry_delay           = 1 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.send_service_user_token = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.split_loggers         = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.timeout               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.tls_ciphers           = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.tls_min_version       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.verify_ssl            = True {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican.verify_ssl_path       = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.auth_section = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.auth_type = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.cafile   = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.certfile = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.collect_timing = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.insecure = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.keyfile  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.split_loggers = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.timeout  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.tls_ciphers = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] barbican_service_user.tls_min_version = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.approle_role_id          = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.approle_secret_id        = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.auth_method              = approle {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.auth_path                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.kv_mountpoint            = secret {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.kv_path                  = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.kv_version               = 2 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.namespace                = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.root_token_id            = **** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.ssl_ca_crt_file          = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.timeout                  = 60.0 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.token_file               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.token_role               = None {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.use_ssl                  = False {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:00 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] ******************************************************************************** {{(pid=85986) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 16:29:01 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.410s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 succeeded
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:01 devstack sudo[86307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:01 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:01 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.227s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.volume.driver [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.driver [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86199) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_db.sqlalchemy.engines [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG dbcounter [-] [86199] Writer thread running {{(pid=86199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.db.api [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Building query based on filter {{(pid=86199) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.image.image_utils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86199) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.keymgr.migration [None req-265e5829-8e81-4796-a7eb-a1445817dffd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:01 devstack sudo[86310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:01 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:01 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.228s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Notifying Schedulers of capabilities ... {{(pid=86199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Driver initialization completed successfully.
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Initiating service 3 cleanup
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Service 3 cleanup completed.
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.service [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Creating RPC server for service cinder-volume {{(pid=86199) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.service [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86199) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 16:29:01 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:01 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:01 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:01 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:02 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:02 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.250s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:02 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-b46d0ca9-dafe-4d87-b6a5-1a2552f563cd None None] Driver post RPC initialization completed successfully.
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86199) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG cinder.volume.drivers.quobyte [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86199) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86199) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:06 devstack sudo[86432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:06 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:06 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG oslo_concurrency.processutils [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.224s {{(pid=86199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:06 devstack cinder-volume[86199]: DEBUG cinder.manager [None req-5a04f9e3-d8f7-4b4d-b4b6-d973519d699e None None] Notifying Schedulers of capabilities ... {{(pid=86199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:29:10 devstack cinder-volume[85986]: INFO oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Caught SIGTERM, stopping children
Sep 29 16:29:10 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Acquiring lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:29:10 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Acquired lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:29:10 devstack cinder-volume[85986]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Releasing lock "singleton_lock" {{(pid=85986) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:29:10 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Stop services. {{(pid=85986) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 16:29:10 devstack cinder-volume[85986]: DEBUG oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Killing children. {{(pid=85986) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 16:29:10 devstack cinder-volume[85986]: INFO oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Waiting on 1 children to exit
Sep 29 16:29:12 devstack cinder-volume[86199]: DEBUG dbcounter [-] [86199] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:29:12 devstack cinder-volume[86199]: DEBUG dbcounter [-] [86199] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:29:15 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Acquiring lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:29:15 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Acquired lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:29:15 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Releasing lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:29:15 devstack cinder-volume[86199]: WARNING amqp [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 16:29:15 devstack cinder-volume[86199]: WARNING amqp [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 16:29:15 devstack cinder-volume[85986]: INFO oslo_service.backend._eventlet.service [None req-a9b401d9-a158-46df-933a-5bb301237f64 None None] Child 86199 exited with status 0
Sep 29 16:29:15 devstack cinder-volume[86551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 16:29:15 devstack cinder-volume[86551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 16:29:15 devstack cinder-volume[86551]: we strongly recommend against using it for new projects.
Sep 29 16:29:15 devstack cinder-volume[86551]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 16:29:15 devstack cinder-volume[86551]: framework.  For more detail see
Sep 29 16:29:15 devstack cinder-volume[86551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 16:29:15 devstack cinder-volume[86551]:   import eventlet  # noqa
Sep 29 16:29:18 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 16:29:18 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 16:29:18 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 16:29:18 devstack cinder-volume[86551]: INFO dbcounter [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Registered counter for database cinder
Sep 29 16:29:18 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:29:19 devstack cinder-volume[86551]: INFO cinder.rpc [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 16:29:19 devstack cinder-volume[86551]: INFO cinder.rpc [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:19 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Determined volume DB was empty at startup.
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG cinder.volume.manager [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86551) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 16:29:19 devstack cinder-volume[86551]: WARNING stevedore.named [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 16:29:19 devstack cinder-volume[86551]: WARNING castellan.key_manager [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:29:19 devstack cinder-volume[86551]: WARNING cinder.keymgr.conf_key_mgr [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 16:29:19 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:19 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Starting 1 workers
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Started child 86843 {{(pid=86551) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Full set of CONF: {{(pid=86551) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] Configuration options gathered from: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] ================================================================================ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] allow_availability_zone_fallback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] allow_compression_on_image_upload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] allowed_direct_url_schemes     = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] api_rate_limit                 = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] auth_strategy                  = keystone {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86843]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_availability_zone      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_host                   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_name                   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_stats_polling_interval = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backup_api_class               = cinder.backup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backup_name_template           = backup-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backup_use_same_host           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backup_use_temp_snapshot       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] chap_password                  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] chap_username                  =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_internal_tenant_project_id = 90f17d5417d04aa3996697327be52a75 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_internal_tenant_user_id = 1ffb5fbbff7046e09a54e1c00bba9ef0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cluster                        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] compression_format             = gzip {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] config_dir                     = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] config_source                  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] control_exchange               = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] debug                          = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] default_availability_zone      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] default_group_type             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] default_volume_type            = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] disk_geometry                  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_client_cert             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_client_cert_key         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_data_namespace          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_ssl_cert_path           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_ssl_cert_verify         = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] driver_use_ssl                 = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] enable_new_services            = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] enable_unsupported_driver      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] filter_function                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_api_insecure            = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_api_ssl_compression     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_ca_certificates_file    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_certfile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_keyfile                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_num_retries             = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance_request_timeout         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] goodness_function              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] graceful_shutdown_timeout      = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] group_api_class                = cinder.group.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] host                           = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_compress_on_upload       = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_conversion_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_conversion_cpu_limit     = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_conversion_disable       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_introspection_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_introspection_cpu_limit  = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_volume_cache_enabled     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_volume_cache_max_count   = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] init_host_max_objects_retrieval = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iscsi_target_flags             =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iscsi_write_cache              = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iser_helper                    = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iser_ip_address                = 192.168.122.131 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iser_port                      = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_color                      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_config_append              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_dir                        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_file                       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_options                    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_rotate_interval            = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_rotate_interval_type       = days {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] log_rotation_type              = none {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] max_age                        = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] max_logfile_count              = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] max_logfile_size_mb            = 200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] max_over_subscription_ratio    = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] message_reap_interval          = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] message_ttl                    = 2592000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] migration_create_volume_timeout_secs = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] monkey_patch                   = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] monkey_patch_modules           = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] my_ip                          = 192.168.122.131 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] no_snapshot_gb_quota           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] num_iser_scan_tries            = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] num_shell_tries                = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] num_volume_device_scan_tries   = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] nvmeof_conn_info_version       = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] nvmet_ns_id                    = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] nvmet_port_id                  = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_max_limit                = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_ext_list          = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_listen_port       = 8776 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_use_ssl           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] osapi_volume_workers           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] per_volume_size_limit          = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] periodic_fuzzy_delay           = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] periodic_interval              = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] public_endpoint                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] publish_errors                 = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_backup_gigabytes         = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_backups                  = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_gigabytes                = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_groups                   = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_snapshots                = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] quota_volumes                  = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] rate_limit_burst               = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] rate_limit_except_level        = CRITICAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] rate_limit_interval            = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] reinit_driver_count            = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] replication_device             = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] report_discard_supported       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] report_interval                = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86843) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] reservation_clean_interval     = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] reservation_expire             = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] reserved_image_namespaces      = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] reserved_percentage            = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] rpc_response_timeout           = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] run_external_periodic_tasks    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] scst_target_driver             = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] scst_target_iqn_name           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_down_time              = 720 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] shell_completion               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] snapshot_name_template         = snapshot-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] split_loggers                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] state_path                     = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] storage_availability_zone      = nova {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] storage_protocol               = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] syslog_log_facility            = LOG_USER {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_helper                  = lioadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_ip_address              = 192.168.122.131 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_port                    = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_protocol                = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] target_secondary_ip_addresses  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] trace_flags                    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] transport_url                  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] until_refresh                  = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_chap_auth                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_default_quota_class        = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_journal                    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_json                       = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_multipath_for_image_xfer   = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_stderr                     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] use_syslog                     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] verify_glance_signatures       = enabled {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_api_class               = cinder.volume.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_backend_name            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_clear                   = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_clear_ionice            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_clear_size              = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_copy_bps_limit          = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_dd_blocksize            = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_name_template           = volume-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_service_inithost_offload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volume_usage_audit_period      = month {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] zoning_mode                    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_concurrency.disable_process_locking = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.auth_type   = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.auth_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.cache       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.certfile    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.include_service_catalog = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.insecure    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.interface   = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.keyfile     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcache_username = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.region_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.service_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.backend                  = dogpile.cache.null {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.backend_argument         = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.backend_expiration_time  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.config_prefix            = cache.oslo {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.debug_cache_backend      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.enable_retry_client      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.enable_socket_keepalive  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.enabled                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.expiration_time          = 600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.hashclient_retry_attempts = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_dead_retry      = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_sasl_enabled    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.password                 = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.proxies                  = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.redis_db                 = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.redis_server             = localhost:6379 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.retry_attempts           = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.retry_delay              = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.socket_keepalive_count   = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.socket_keepalive_idle    = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.socket_keepalive_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.socket_timeout           = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.tls_allowed_ciphers      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.tls_cafile               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.tls_certfile             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.tls_enabled              = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.tls_keyfile              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cache.username                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] coordination.backend_url       = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.asyncio_connection    = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.asyncio_slave_connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.backend               = sqlalchemy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.connection            = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.connection_debug      = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.connection_parameters =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.connection_recycle_time = 3600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86843) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.connection_trace      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.db_inc_retry_interval = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.db_max_retries        = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.db_max_retry_interval = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.db_retry_interval     = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.max_overflow          = 50 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.max_pool_size         = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.max_retries           = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.mysql_wsrep_sync_wait = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.pool_timeout          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.retry_interval        = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.slave_connection      = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.sqlite_synchronous    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.synchronous_reader    = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] database.use_db_reconnect      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_tracing.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.connection_string     = messaging:// {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.enabled               = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.es_doc_type           = notification {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.es_scroll_size        = 10000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.es_scroll_time        = 2m {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.filter_error_trace    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.hmac_keys             = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.socket_timeout        = 0.1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.trace_requests        = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler.trace_sqlalchemy      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler_jaeger.process_tags   = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler_jaeger.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] profiler_otlp.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.enforce_new_defaults = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.policy_default_rule = default {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.group          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] privsep_osbrick.user           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.group         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] cinder_sys_admin.user          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.auth_section      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.auth_type         = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.cafile            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.certfile          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.collect_timing    = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.insecure          = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.keyfile           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.send_service_user_token = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.split_loggers     = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.timeout           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.tls_ciphers       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] service_user.tls_min_version   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.auth_section            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.auth_type               = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.certfile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.collect_timing          = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.insecure                = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.keyfile                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.region_name             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.split_loggers           = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.timeout                 = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.tls_ciphers             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] glance.tls_min_version         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.chap_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.chap_username =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.disk_geometry = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_client_cert = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.driver_use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.extra_capabilities = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.filter_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.goodness_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iscsi_target_flags =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iscsi_write_cache = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iser_port     = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_host      =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_login     = admin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_mount_options = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_password  = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_private_key =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_share_path =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.num_shell_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.quobyte_volume_url = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.replication_device = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.report_discard_supported = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.reserved_percentage = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_helper = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_port   = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_protocol = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.trace_flags   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.unique_fqdn_network = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.use_chap_auth = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_backend_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_clear  = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_clear_ionice = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_clear_size = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_reports.file_event_handler = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack quobyte-client[86847]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_reports.log_dir           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack quobyte-client[86847]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.backend_host         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.chap_password        = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.chap_username        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.disk_geometry        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_client_cert   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.extra_capabilities   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.filter_function      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.goodness_function    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iser_helper          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iser_ip_address      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iser_port            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_host             = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_login            = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_mount_options    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_password         = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_private_key      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_share_path       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.num_shell_tries      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.replication_device   = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.report_discard_supported = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.reserved_percentage  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.scst_target_driver   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.storage_protocol     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_helper        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_ip_address    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_port          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_prefix        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_protocol      = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.trace_flags          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.use_chap_auth        = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_clear         = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_clear_size    = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] QuobyteHD.volumes_dir          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_notifications.driver = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_notifications.retry = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] key_manager.fixed_key          = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.barbican_api_version  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.barbican_endpoint     = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.barbican_endpoint_type = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.barbican_region_name  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.cafile                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.certfile              = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.collect_timing        = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.insecure              = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.keyfile               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.number_of_retries     = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.retry_delay           = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.send_service_user_token = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.split_loggers         = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.timeout               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.tls_ciphers           = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.tls_min_version       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.verify_ssl            = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican.verify_ssl_path       = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.auth_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.cafile   = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.keyfile  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.timeout  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] barbican_service_user.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.approle_role_id          = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.approle_secret_id        = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.auth_method              = approle {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.auth_path                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.kv_mountpoint            = secret {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.kv_path                  = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.kv_version               = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.namespace                = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.root_token_id            = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.ssl_ca_crt_file          = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.timeout                  = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.token_file               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.token_role               = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.use_ssl                  = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 16:29:19 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-87e53a3a-eeb6-4268-a79c-cc5bda819232 None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 16:29:19 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:19 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:19 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:19 devstack cinder-volume[86843]: INFO cinder.volume.driver [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.driver [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86843) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writer thread running {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.db.api [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Building query based on filter {{(pid=86843) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86843) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:19 devstack cinder-volume[86843]: INFO cinder.keymgr.migration [None req-5f472726-ca6c-4f28-854f-47fde5c27a35 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 16:29:19 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:19 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:20 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.222s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:29:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Driver initialization completed successfully.
Sep 29 16:29:20 devstack cinder-volume[86843]: INFO cinder.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Initiating service 3 cleanup
Sep 29 16:29:20 devstack cinder-volume[86843]: INFO cinder.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Service 3 cleanup completed.
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG cinder.service [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Creating RPC server for service cinder-volume {{(pid=86843) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG cinder.service [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86843) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 16:29:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:29:20 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:29:20 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:29:20 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Sep 29 16:29:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.237s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:29:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-69542cde-c079-4413-8718-ffea471af5c5 None None] Driver post RPC initialization completed successfully.
Sep 29 16:29:29 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:29:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:29:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=3 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:29:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:29:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 6 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:29:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Flow 'volume_create_manager' (026d20f3-a260-4eec-86d6-ec325d7aefdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0949a693-3c8b-4e18-aafa-a8a29fd81c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0949a693-3c8b-4e18-aafa-a8a29fd81c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-611376604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d974c3ca-9393-4916-9a7d-b8ac645bb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29105aee3174379981146c502b60e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:30:40Z,use_quota=True,user_id='341106c3a7414a15bf002fb6227df0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c35087e-fd0b-42e8-a1d9-efa5dd3c61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c35087e-fd0b-42e8-a1d9-efa5dd3c61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82972c11-7a4a-4ea9-a382-b4a977fb2a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82972c11-7a4a-4ea9-a382-b4a977fb2a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd974c3ca-9393-4916-9a7d-b8ac645bb5ff', 'volume_name': 'volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418f0ba-e647-481a-823c-8ca9c4d40bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418f0ba-e647-481a-823c-8ca9c4d40bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f20a3a-c24b-42ed-b130-ae70530cbeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Volume d974c3ca-9393-4916-9a7d-b8ac645bb5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff', 'volume_size': 1}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-611376604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d974c3ca-9393-4916-9a7d-b8ac645bb5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29105aee3174379981146c502b60e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:30:40Z,use_quota=True,user_id='341106c3a7414a15bf002fb6227df0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Creating volume d974c3ca-9393-4916-9a7d-b8ac645bb5ff {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:30:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:30:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:30:40 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:30:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:40 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff 1073741824
Sep 29 16:30:40 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:40 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff 1073741824" returned: 0 in 0.972s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:41 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff
Sep 29 16:30:41 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:41 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" returned: 0 in 0.686s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f20a3a-c24b-42ed-b130-ae70530cbeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebef48d-8eef-482f-8cc1-dd131b416d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:41 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Volume volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff (d974c3ca-9393-4916-9a7d-b8ac645bb5ff): created successfully
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebef48d-8eef-482f-8cc1-dd131b416d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Flow 'volume_create_manager' (026d20f3-a260-4eec-86d6-ec325d7aefdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:30:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a0e4fca4-201e-443b-ad91-9bb1701fcce0 tempest-DeleteServersTestJSON-1191259951 None] Created volume successfully.
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Flow 'volume_create_manager' (c5938d22-68f8-4594-8390-b77e5f31907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb77a99-e1f4-4553-90ed-44dcc36ee2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb77a99-e1f4-4553-90ed-44dcc36ee2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1073127917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca6344b-a43a-4614-907b-b5ed749e5670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f521b3c6d435f984699706ecb2e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:30:44Z,use_quota=True,user_id='9bc4be0a6f6c46879020a83ffe859a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de5de0-7c26-4241-a37f-6109dc904744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de5de0-7c26-4241-a37f-6109dc904744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fa7359-b9ac-4753-9635-09c282bdc05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fa7359-b9ac-4753-9635-09c282bdc05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca6344b-a43a-4614-907b-b5ed749e5670', 'volume_name': 'volume-dca6344b-a43a-4614-907b-b5ed749e5670', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9baec1-a42e-4092-9eda-271f138474d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9baec1-a42e-4092-9eda-271f138474d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b9fb5d-a54f-4fdc-b5b7-5a1007a5cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:44 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Volume dca6344b-a43a-4614-907b-b5ed749e5670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca6344b-a43a-4614-907b-b5ed749e5670', 'volume_size': 1}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1073127917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca6344b-a43a-4614-907b-b5ed749e5670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f521b3c6d435f984699706ecb2e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:30:44Z,use_quota=True,user_id='9bc4be0a6f6c46879020a83ffe859a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Creating volume dca6344b-a43a-4614-907b-b5ed749e5670 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:30:44 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:30:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:44 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 1073741824
Sep 29 16:30:44 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:45 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 1073741824" returned: 0 in 1.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:46 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670
Sep 29 16:30:46 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:46 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670" returned: 0 in 0.687s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b9fb5d-a54f-4fdc-b5b7-5a1007a5cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca6344b-a43a-4614-907b-b5ed749e5670', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803c5fbf-765e-4312-bbe2-f2097aa33a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:30:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Volume volume-dca6344b-a43a-4614-907b-b5ed749e5670 (dca6344b-a43a-4614-907b-b5ed749e5670): created successfully
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803c5fbf-765e-4312-bbe2-f2097aa33a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:30:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Flow 'volume_create_manager' (c5938d22-68f8-4594-8390-b77e5f31907e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:30:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8e741603-45de-4704-b5dd-30e4c5fcbf74 tempest-VolumesAdminNegativeTest-370979372 None] Created volume successfully.
Sep 29 16:30:48 devstack cinder-volume[86843]: WARNING py.warnings [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 29 16:30:48 devstack cinder-volume[86843]:   .first()
Sep 29 16:30:48 devstack cinder-volume[86843]: 
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '836dabe5-8192-4693-9587-bd229ef14eb8', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Acquiring lock "cinder-dca6344b-a43a-4614-907b-b5ed749e5670-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:30:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "cinder-dca6344b-a43a-4614-907b-b5ed749e5670-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:30:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-008857be-1e63-4c54-9f1c-ed1a1c0e95d9 req-e6d64e69-14ab-46d4-8504-88f91abcc497 tempest-DeleteServersTestJSON-1191259951 None] attachment_update completed successfully.
Sep 29 16:30:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Acquiring lock "cinder-quobyte-dca6344b-a43a-4614-907b-b5ed749e5670" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:30:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "cinder-quobyte-dca6344b-a43a-4614-907b-b5ed749e5670" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:30:49 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6vzpxpi8/privsep.sock']
Sep 29 16:30:49 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6vzpxpi8/privsep.sock
Sep 29 16:30:49 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 16:30:50 devstack cinder-volume[86843]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 29 16:30:51 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:51 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Spawned new privsep daemon via rootwrap
Sep 29 16:30:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Accepted privsep connection to /tmp/tmp6vzpxpi8/privsep.sock {{(pid=86843) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 29 16:30:51 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 29 16:30:51 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 29 16:30:51 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 29 16:30:51 devstack cinder-volume[86843]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88505
Sep 29 16:30:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f7818a-dd5b-452c-8450-42a4dfa7af5a]: (2,) {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:30:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[43429118-eb56-4e55-9032-e9de96a033c3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:30:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:51 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670
Sep 29 16:30:51 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:52 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670" returned: 0 in 0.564s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:52 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670
Sep 29 16:30:52 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:52 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dca6344b-a43a-4614-907b-b5ed749e5670" returned: 0 in 0.513s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "cinder-quobyte-dca6344b-a43a-4614-907b-b5ed749e5670" released by "delete_volume" :: held 3.508s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:30:52 devstack cinder-volume[86843]: WARNING cinder.quota [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:30:52 devstack cinder-volume[86843]: WARNING cinder.quota [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:30:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Created reservations ['5ff7a0ba-fae1-4064-9a42-b0c7b3f4a1c5', '54778dee-f6bc-40eb-8fff-5b4ecb22054a', '88ab2322-936d-4320-ad9d-a7e8aca7aa9e', '6052d2bf-839f-47f9-ac2d-96bd7e61fc72'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:53 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:30:53 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:30:53 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.390s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:53 devstack sudo[88525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:30:53 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:30:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Deleted volume successfully.
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da661a96-2c43-4a9f-bce7-bd10ced87f8a tempest-VolumesAdminNegativeTest-370979372 None] Lock "cinder-dca6344b-a43a-4614-907b-b5ed749e5670-delete_volume" released by "delete_volume" :: held 4.724s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:30:53 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 8 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:30:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:30:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-eaf19d0b-e859-4d3b-90d5-d48a9429acac req-b6d3b294-a4ce-4836-9307-0d07bc817dac tempest-DeleteServersTestJSON-1191259951 None] Terminate volume connection completed successfully.
Sep 29 16:30:56 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-eaf19d0b-e859-4d3b-90d5-d48a9429acac req-b6d3b294-a4ce-4836-9307-0d07bc817dac tempest-DeleteServersTestJSON-1191259951 None] Deleting attachment 836dabe5-8192-4693-9587-bd229ef14eb8. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "cinder-d974c3ca-9393-4916-9a7d-b8ac645bb5ff-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "cinder-d974c3ca-9393-4916-9a7d-b8ac645bb5ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "cinder-quobyte-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "cinder-quobyte-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[742accb0-aba6-4762-8faa-dcd8acfda85c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:30:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:30:59 devstack sudo[88619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff
Sep 29 16:30:59 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:00 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:00 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff
Sep 29 16:31:00 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:00 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" returned: 0 in 0.300s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "cinder-quobyte-d974c3ca-9393-4916-9a7d-b8ac645bb5ff" released by "delete_volume" :: held 0.832s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Created reservations ['377c307d-7960-48a9-ab60-9d52fe72bfb3', '6d6cd1d5-a507-4bb0-ba40-c3c57a38b7c8', '89ddc8f4-4848-461f-bd00-44f7c5b9c92e', '2685e04b-76c2-47e9-b6ba-c6f8c0175b0f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:00 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:31:00 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:01 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.398s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:01 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:31:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Deleted volume successfully.
Sep 29 16:31:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e73e6bc2-d849-4a61-ba73-8f6df312262d tempest-DeleteServersTestJSON-1191259951 None] Lock "cinder-d974c3ca-9393-4916-9a7d-b8ac645bb5ff-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:31:10 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=24,cinder:INSERT=4,cinder:SELECT=15 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:31:11 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Flow 'volume_create_manager' (42b6da23-be5d-4387-b3aa-7e1944607469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60773a9a-7b2c-43cf-9a95-4d665323d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60773a9a-7b2c-43cf-9a95-4d665323d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-250358060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9e2d0f7f47485297418b0b06b92a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:13Z,use_quota=True,user_id='bf901491aee047c3a6d2feec5d811b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e763de4-697e-4bcf-afe5-020858f387a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e763de4-697e-4bcf-afe5-020858f387a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c255f2ce-6afa-4c2c-bb45-2d6d68902620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c255f2ce-6afa-4c2c-bb45-2d6d68902620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'volume_name': 'volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f6b166-dcb1-44ee-8933-97734c7f4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f6b166-dcb1-44ee-8933-97734c7f4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311660d9-4545-424b-9609-131a9803baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:13 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Volume 1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'volume_size': 1}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-250358060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9e2d0f7f47485297418b0b06b92a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:13Z,use_quota=True,user_id='bf901491aee047c3a6d2feec5d811b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Creating volume 1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:31:13 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:13 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca 1073741824
Sep 29 16:31:13 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:13 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca 1073741824" returned: 0 in 0.604s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:14 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca
Sep 29 16:31:14 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:14 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" returned: 0 in 0.316s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311660d9-4545-424b-9609-131a9803baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb6efd9-09d9-4920-9da3-44e07f4b6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Volume volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca (1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca): created successfully
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb6efd9-09d9-4920-9da3-44e07f4b6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Flow 'volume_create_manager' (42b6da23-be5d-4387-b3aa-7e1944607469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:31:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1a3762ce-6af4-4037-b488-90ac233ebfe7 tempest-ServerActionsTestOtherA-1887375856 None] Created volume successfully.
Sep 29 16:31:24 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Flow 'volume_create_manager' (61f7360a-602e-401b-9df7-47f6441d31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f6de9c-b8d6-4f5f-8850-7fa77c26eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f6de9c-b8d6-4f5f-8850-7fa77c26eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-719450377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773a324e-543f-43df-8332-f530a1880f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba21334b78c443eb68fc227fbfc5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:30Z,use_quota=True,user_id='0c7bf4b2543d44c6a6bfd095b5679f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72046471-93f5-4f76-9779-75d2a6a8beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72046471-93f5-4f76-9779-75d2a6a8beb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850cb3e3-2d4f-4ade-843a-e4b4b5d97e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850cb3e3-2d4f-4ade-843a-e4b4b5d97e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773a324e-543f-43df-8332-f530a1880f35', 'volume_name': 'volume-773a324e-543f-43df-8332-f530a1880f35', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52bfca-085a-4dbf-8f0f-f0b04e3a2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52bfca-085a-4dbf-8f0f-f0b04e3a2705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6c7161-5d8c-4905-b575-b2841b88aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:30 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Volume 773a324e-543f-43df-8332-f530a1880f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773a324e-543f-43df-8332-f530a1880f35', 'volume_size': 1}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-719450377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773a324e-543f-43df-8332-f530a1880f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba21334b78c443eb68fc227fbfc5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:30Z,use_quota=True,user_id='0c7bf4b2543d44c6a6bfd095b5679f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Creating volume 773a324e-543f-43df-8332-f530a1880f35 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:31:30 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:30 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 1073741824
Sep 29 16:31:30 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:30 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 1073741824" returned: 0 in 0.619s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:30 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35
Sep 29 16:31:30 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:31 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35" returned: 0 in 0.344s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6c7161-5d8c-4905-b575-b2841b88aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773a324e-543f-43df-8332-f530a1880f35', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71e55ae-e0af-43c6-8933-21fc5b86857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:31:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Volume volume-773a324e-543f-43df-8332-f530a1880f35 (773a324e-543f-43df-8332-f530a1880f35): created successfully
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f71e55ae-e0af-43c6-8933-21fc5b86857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:31:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Flow 'volume_create_manager' (61f7360a-602e-401b-9df7-47f6441d31b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:31:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4ada4ed2-7202-40f4-add9-375eb1d38f7e tempest-TaggedAttachmentsTest-1455610019 None] Created volume successfully.
Sep 29 16:31:41 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:31:41 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:31:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:31:53 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:31:53 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:31:54 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Sep 29 16:31:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.548s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:31:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:32:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4e586383-c7fd-4cf7-9c5c-3fb0a9dd8536 req-5bf43186-c816-46e7-b0e7-50543bfb64b5 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4e586383-c7fd-4cf7-9c5c-3fb0a9dd8536 req-5bf43186-c816-46e7-b0e7-50543bfb64b5 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4e586383-c7fd-4cf7-9c5c-3fb0a9dd8536 req-5bf43186-c816-46e7-b0e7-50543bfb64b5 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-4e586383-c7fd-4cf7-9c5c-3fb0a9dd8536 req-5bf43186-c816-46e7-b0e7-50543bfb64b5 tempest-ServerActionsTestOtherA-1887375856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64c7baaa-5958-4dc7-a507-9ed90b20f5b1', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:32:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-4e586383-c7fd-4cf7-9c5c-3fb0a9dd8536 req-5bf43186-c816-46e7-b0e7-50543bfb64b5 tempest-ServerActionsTestOtherA-1887375856 None] attachment_update completed successfully.
Sep 29 16:32:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-84bcfed8-b273-40e8-8635-8e06e8e298a9 tempest-ServerActionsTestOtherA-1887375856 None] Terminate volume connection completed successfully.
Sep 29 16:32:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-84bcfed8-b273-40e8-8635-8e06e8e298a9 tempest-ServerActionsTestOtherA-1887375856 None] Deleting attachment 64c7baaa-5958-4dc7-a507-9ed90b20f5b1. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:32:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-d4f451ed-a37d-4205-8bdd-009243f045cb tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-d4f451ed-a37d-4205-8bdd-009243f045cb tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-d4f451ed-a37d-4205-8bdd-009243f045cb tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-d4f451ed-a37d-4205-8bdd-009243f045cb tempest-ServerActionsTestOtherA-1887375856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d53d7b2-97e0-4e2d-b37b-7d781b924275', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:32:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-eb6fa7ac-a59e-4c83-b8a3-d49de9cd4d98 req-d4f451ed-a37d-4205-8bdd-009243f045cb tempest-ServerActionsTestOtherA-1887375856 None] attachment_update completed successfully.
Sep 29 16:32:19 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:32:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (a9d9e092-3046-4044-9af6-cb935dd995b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9af9656-5c4c-4b92-a06d-cdc2869d2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9af9656-5c4c-4b92-a06d-cdc2869d2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1743106882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9d1564-8704-475a-bddb-c8aaf74215d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:20Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1baeff0-2d6e-4ae9-af12-c631212e14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1baeff0-2d6e-4ae9-af12-c631212e14f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f75325-07da-4fcc-9e20-eb9083efbebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f75325-07da-4fcc-9e20-eb9083efbebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9d1564-8704-475a-bddb-c8aaf74215d7', 'volume_name': 'volume-af9d1564-8704-475a-bddb-c8aaf74215d7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2164c9e0-2981-47ed-a805-8e9924a36264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2164c9e0-2981-47ed-a805-8e9924a36264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691a433f-a712-4865-83af-da62342e398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Volume af9d1564-8704-475a-bddb-c8aaf74215d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9d1564-8704-475a-bddb-c8aaf74215d7', 'volume_size': 1}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1743106882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9d1564-8704-475a-bddb-c8aaf74215d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:20Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Creating volume af9d1564-8704-475a-bddb-c8aaf74215d7 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:32:20 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:32:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:20 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 1073741824
Sep 29 16:32:20 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:21 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 1073741824" returned: 0 in 0.962s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:21 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7
Sep 29 16:32:21 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:21 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7" returned: 0 in 0.699s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691a433f-a712-4865-83af-da62342e398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9d1564-8704-475a-bddb-c8aaf74215d7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e0be0f-dcd1-4eae-831e-0ee79b841068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Volume volume-af9d1564-8704-475a-bddb-c8aaf74215d7 (af9d1564-8704-475a-bddb-c8aaf74215d7): created successfully
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e0be0f-dcd1-4eae-831e-0ee79b841068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (a9d9e092-3046-4044-9af6-cb935dd995b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3a82ac9d-1e29-4ada-a5eb-10bd38a521b9 tempest-AttachVolumeTestJSON-1576357736 None] Created volume successfully.
Sep 29 16:32:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-5695a133-8fe9-40ea-a0a8-9a5647befa59 req-397ff75f-3ca8-402c-8549-54960c7ae527 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-5695a133-8fe9-40ea-a0a8-9a5647befa59 req-397ff75f-3ca8-402c-8549-54960c7ae527 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-5695a133-8fe9-40ea-a0a8-9a5647befa59 req-397ff75f-3ca8-402c-8549-54960c7ae527 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-5695a133-8fe9-40ea-a0a8-9a5647befa59 req-397ff75f-3ca8-402c-8549-54960c7ae527 tempest-AttachVolumeTestJSON-1576357736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-af9d1564-8704-475a-bddb-c8aaf74215d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a00d70cd-07cb-4942-a65b-a9d0bee504f9', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:32:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-5695a133-8fe9-40ea-a0a8-9a5647befa59 req-397ff75f-3ca8-402c-8549-54960c7ae527 tempest-AttachVolumeTestJSON-1576357736 None] attachment_update completed successfully.
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Flow 'volume_create_manager' (aa3655d8-e69d-4758-9bea-9faf1ca18cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e57600-acbb-43fc-928e-23e87cf7ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e57600-acbb-43fc-928e-23e87cf7ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1774675986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48acaf02-ae6d-4b61-9db8-d299a8a8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc766a604744198a657012a372ee048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:27Z,use_quota=True,user_id='effc901b952f4e0d83a1cd1ce0af99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b391e699-300e-4f66-88b1-cabaf9ce7dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b391e699-300e-4f66-88b1-cabaf9ce7dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b558f183-d5e4-4374-bfb9-2389362e6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b558f183-d5e4-4374-bfb9-2389362e6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48acaf02-ae6d-4b61-9db8-d299a8a8474b', 'volume_name': 'volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5700ae-35ab-4b12-893e-84d7b9a09bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5700ae-35ab-4b12-893e-84d7b9a09bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec8d092-0a53-4ba5-a8a8-0b864f26267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Volume 48acaf02-ae6d-4b61-9db8-d299a8a8474b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b', 'volume_size': 1}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1774675986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48acaf02-ae6d-4b61-9db8-d299a8a8474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc766a604744198a657012a372ee048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:27Z,use_quota=True,user_id='effc901b952f4e0d83a1cd1ce0af99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Creating volume 48acaf02-ae6d-4b61-9db8-d299a8a8474b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:32:26 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:32:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:26 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b 1073741824
Sep 29 16:32:26 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:27 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b 1073741824" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:27 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b
Sep 29 16:32:27 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:28 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec8d092-0a53-4ba5-a8a8-0b864f26267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b97475-5145-4b85-a564-5db582022e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:28 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Volume volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b (48acaf02-ae6d-4b61-9db8-d299a8a8474b): created successfully
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b97475-5145-4b85-a564-5db582022e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Flow 'volume_create_manager' (aa3655d8-e69d-4758-9bea-9faf1ca18cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-32797891-3c50-4268-b664-ed1b3c611050 tempest-ServersNegativeTestJSON-1480067734 None] Created volume successfully.
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Flow 'volume_create_manager' (cf00a01b-1c03-4182-883e-9d6d59db87a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfcfb80-be32-4c66-a352-25b509bffa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfcfb80-be32-4c66-a352-25b509bffa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1225082196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c44d0e-41ad-4f8f-84ed-f66879cae185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc766a604744198a657012a372ee048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:32Z,use_quota=True,user_id='effc901b952f4e0d83a1cd1ce0af99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3285cbb-8cd5-4983-95ce-104d1eb40967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3285cbb-8cd5-4983-95ce-104d1eb40967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2805d9b9-f425-4ba3-b093-e4066f01eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2805d9b9-f425-4ba3-b093-e4066f01eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c44d0e-41ad-4f8f-84ed-f66879cae185', 'volume_name': 'volume-81c44d0e-41ad-4f8f-84ed-f66879cae185', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd0673d-f936-4669-b03f-2545a5d06b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd0673d-f936-4669-b03f-2545a5d06b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ccffdd-5158-4853-a1c4-d0eca3ae6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Volume 81c44d0e-41ad-4f8f-84ed-f66879cae185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c44d0e-41ad-4f8f-84ed-f66879cae185', 'volume_size': 1}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1225082196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c44d0e-41ad-4f8f-84ed-f66879cae185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fc766a604744198a657012a372ee048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:32Z,use_quota=True,user_id='effc901b952f4e0d83a1cd1ce0af99a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Creating volume 81c44d0e-41ad-4f8f-84ed-f66879cae185 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:32:31 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:32:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:31 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 1073741824
Sep 29 16:32:31 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:32 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 1073741824" returned: 0 in 0.533s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:32 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185
Sep 29 16:32:32 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:32 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ccffdd-5158-4853-a1c4-d0eca3ae6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c44d0e-41ad-4f8f-84ed-f66879cae185', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e600b6d2-9c27-4bc9-bbca-834b0787b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Volume volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 (81c44d0e-41ad-4f8f-84ed-f66879cae185): created successfully
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e600b6d2-9c27-4bc9-bbca-834b0787b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Flow 'volume_create_manager' (cf00a01b-1c03-4182-883e-9d6d59db87a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-44da633c-52e3-4d25-b328-5fd05ffc1fde tempest-ServersNegativeTestJSON-1480067734 None] Created volume successfully.
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "cinder-81c44d0e-41ad-4f8f-84ed-f66879cae185-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-81c44d0e-41ad-4f8f-84ed-f66879cae185-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "cinder-quobyte-81c44d0e-41ad-4f8f-84ed-f66879cae185" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-quobyte-81c44d0e-41ad-4f8f-84ed-f66879cae185" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[66836d70-5247-407a-b5ba-dcd61d37c654]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:34 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185
Sep 29 16:32:34 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:34 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185" returned: 0 in 0.459s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:34 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185
Sep 29 16:32:34 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:35 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-81c44d0e-41ad-4f8f-84ed-f66879cae185" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-quobyte-81c44d0e-41ad-4f8f-84ed-f66879cae185" released by "delete_volume" :: held 0.940s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Created reservations ['82885356-11d0-4bec-bb6e-7b6893e27628', '756b943c-7149-4811-8625-70e2c4abba4e', 'b4bf1895-055e-4d7c-957f-7f63e21391bd', '10fc69d1-5b94-4674-8756-c9823d4a66a2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:35 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:32:35 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:35 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.462s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:35 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:32:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Deleted volume successfully.
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-adadb076-5b4f-40df-bcff-5014df71c89b tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-81c44d0e-41ad-4f8f-84ed-f66879cae185-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "cinder-48acaf02-ae6d-4b61-9db8-d299a8a8474b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-48acaf02-ae6d-4b61-9db8-d299a8a8474b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "cinder-quobyte-48acaf02-ae6d-4b61-9db8-d299a8a8474b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-quobyte-48acaf02-ae6d-4b61-9db8-d299a8a8474b" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[53740e69-07a7-4221-9a87-5aa8c67e3077]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:32:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:36 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b
Sep 29 16:32:36 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:37 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b" returned: 0 in 0.498s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:37 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b
Sep 29 16:32:37 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:37 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-48acaf02-ae6d-4b61-9db8-d299a8a8474b" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-quobyte-48acaf02-ae6d-4b61-9db8-d299a8a8474b" released by "delete_volume" :: held 0.900s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Created reservations ['29160e89-4b7b-46b1-85e7-88b0ed9ec539', '701d607b-f251-4128-8488-16693bec9bce', '3a9f55d8-c9af-41ba-b3cc-9836a0d4c479', '97b25f76-2448-42db-9346-4d2193be3b41'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:37 devstack sudo[90676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:32:37 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:38 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:38 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:32:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Deleted volume successfully.
Sep 29 16:32:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73ec51cf-07bc-49e5-999f-a34789ba75ed tempest-ServersNegativeTestJSON-1480067734 None] Lock "cinder-48acaf02-ae6d-4b61-9db8-d299a8a8474b-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-47ebb8b2-4b27-4335-86ed-f3ead9a743ea req-77de13b9-e1c7-4c41-a162-8f88c6312173 tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-47ebb8b2-4b27-4335-86ed-f3ead9a743ea req-77de13b9-e1c7-4c41-a162-8f88c6312173 tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-47ebb8b2-4b27-4335-86ed-f3ead9a743ea req-77de13b9-e1c7-4c41-a162-8f88c6312173 tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-47ebb8b2-4b27-4335-86ed-f3ead9a743ea req-77de13b9-e1c7-4c41-a162-8f88c6312173 tempest-TaggedAttachmentsTest-1455610019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-773a324e-543f-43df-8332-f530a1880f35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7f260ec-3b04-404e-a2a0-60b122de88c8', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:32:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-47ebb8b2-4b27-4335-86ed-f3ead9a743ea req-77de13b9-e1c7-4c41-a162-8f88c6312173 tempest-TaggedAttachmentsTest-1455610019 None] attachment_update completed successfully.
Sep 29 16:32:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-91d2bd6a-475a-4a40-901e-4a877c490766 req-50e5f7c1-a26c-4514-9b63-b5e2e85fde34 tempest-TaggedAttachmentsTest-1455610019 None] Terminate volume connection completed successfully.
Sep 29 16:32:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-91d2bd6a-475a-4a40-901e-4a877c490766 req-50e5f7c1-a26c-4514-9b63-b5e2e85fde34 tempest-TaggedAttachmentsTest-1455610019 None] Deleting attachment a7f260ec-3b04-404e-a2a0-60b122de88c8. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:32:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-6e2de8b1-6c1c-4d0f-8495-6423157658d8 req-d5af90fd-b911-46c2-8db9-08ea17760b69 tempest-ServerActionsTestOtherA-1887375856 None] Terminate volume connection completed successfully.
Sep 29 16:32:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-6e2de8b1-6c1c-4d0f-8495-6423157658d8 req-d5af90fd-b911-46c2-8db9-08ea17760b69 tempest-ServerActionsTestOtherA-1887375856 None] Deleting attachment 7d53d7b2-97e0-4e2d-b37b-7d781b924275. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:53 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:32:53 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:53 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 8 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:32:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Flow 'volume_create_manager' (71eb7655-7ba9-48ab-a805-055c962c804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3acdb49-eabe-409b-b2c4-ff47026ef21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3acdb49-eabe-409b-b2c4-ff47026ef21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1338164188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a744d86-a199-4137-a802-47fc414f12bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ca208a38b4cb0ab1aa1a27be17521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:54Z,use_quota=True,user_id='eb65c718c5c547fe9cea021e1d0a243a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085dcda9-cadd-47f3-b778-2cd5d1c46f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085dcda9-cadd-47f3-b778-2cd5d1c46f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aca95-9948-475f-931f-cfcd50a5fb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aca95-9948-475f-931f-cfcd50a5fb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a744d86-a199-4137-a802-47fc414f12bb', 'volume_name': 'volume-8a744d86-a199-4137-a802-47fc414f12bb', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e1a18-71ca-4098-8d2b-5b7509eff76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e1a18-71ca-4098-8d2b-5b7509eff76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127626f4-d0d5-443a-bc5c-4ff1c3b56797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:54 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Volume 8a744d86-a199-4137-a802-47fc414f12bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a744d86-a199-4137-a802-47fc414f12bb', 'volume_size': 1}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1338164188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a744d86-a199-4137-a802-47fc414f12bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ca208a38b4cb0ab1aa1a27be17521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:54Z,use_quota=True,user_id='eb65c718c5c547fe9cea021e1d0a243a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Creating volume 8a744d86-a199-4137-a802-47fc414f12bb {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:32:54 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:32:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:54 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb 1073741824
Sep 29 16:32:54 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:55 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb 1073741824" returned: 0 in 0.562s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:55 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb
Sep 29 16:32:55 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:55 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127626f4-d0d5-443a-bc5c-4ff1c3b56797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a744d86-a199-4137-a802-47fc414f12bb', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec176da7-da14-4787-b999-6918f6f30088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:55 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Volume volume-8a744d86-a199-4137-a802-47fc414f12bb (8a744d86-a199-4137-a802-47fc414f12bb): created successfully
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec176da7-da14-4787-b999-6918f6f30088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Flow 'volume_create_manager' (71eb7655-7ba9-48ab-a805-055c962c804b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-51fbca51-a49e-461b-8ba5-0adf8d6578d2 req-2b82dccb-647e-42ec-8516-504cd8be9ab3 tempest-VolumesGetTestJSON-538243597 None] Created volume successfully.
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Acquiring lock "cinder-8a744d86-a199-4137-a802-47fc414f12bb-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "cinder-8a744d86-a199-4137-a802-47fc414f12bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Acquiring lock "cinder-quobyte-8a744d86-a199-4137-a802-47fc414f12bb" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "cinder-quobyte-8a744d86-a199-4137-a802-47fc414f12bb" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[32284745-d851-48d2-a5bb-e6b489991920]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:57 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb
Sep 29 16:32:57 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:57 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb" returned: 0 in 0.427s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:57 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb
Sep 29 16:32:57 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:58 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8a744d86-a199-4137-a802-47fc414f12bb" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "cinder-quobyte-8a744d86-a199-4137-a802-47fc414f12bb" released by "delete_volume" :: held 0.752s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.quota [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Created reservations ['73d0163a-c329-4940-82a8-cd48c3b090b1', '62ef44f6-4159-4431-a85c-4292b0276bc3', '8770aa0d-0f20-4d34-b831-f74c9d4de546', '1dec75e9-92b8-43bb-95fd-e8377503a975'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:58 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:32:58 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:58 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.manager [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:32:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Deleted volume successfully.
Sep 29 16:32:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-fea0017b-f144-4877-bce5-138e22dce2df req-217b4b95-b90c-492a-a832-032177b10d8d tempest-VolumesGetTestJSON-538243597 None] Lock "cinder-8a744d86-a199-4137-a802-47fc414f12bb-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "cinder-773a324e-543f-43df-8332-f530a1880f35-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "cinder-773a324e-543f-43df-8332-f530a1880f35-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "cinder-quobyte-773a324e-543f-43df-8332-f530a1880f35" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "cinder-quobyte-773a324e-543f-43df-8332-f530a1880f35" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec27a8b-7aec-4d0d-b697-1e6df866643b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:59 devstack sudo[90978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35
Sep 29 16:32:59 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Flow 'volume_create_manager' (b58fb84e-e748-43d1-87fd-27269601b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf46ef-5b6a-4b19-bf74-518085d3c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4daf46ef-5b6a-4b19-bf74-518085d3c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1016699988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90b7b4e-c10d-4629-ae05-e31e601078df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9e2d0f7f47485297418b0b06b92a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:59Z,use_quota=True,user_id='bf901491aee047c3a6d2feec5d811b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e726f2-9f10-4fc8-b638-3d0275dab60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e726f2-9f10-4fc8-b638-3d0275dab60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2f1260-64b8-4eb1-9c00-8ee8ce2bfd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:32:59 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35" returned: 0 in 0.385s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:32:59 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35
Sep 29 16:32:59 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:32:59 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-773a324e-543f-43df-8332-f530a1880f35" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:32:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "cinder-quobyte-773a324e-543f-43df-8332-f530a1880f35" released by "delete_volume" :: held 0.740s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Created reservations ['f0b87f5a-5f52-41c1-b641-e23d23dc28a4', 'd0c2d15c-fd1d-411b-bbf6-83ecbc802c97', '1bf5f8a2-badf-4678-9fd1-4c2abccfe917', 'f56524b0-371f-4725-8aec-6147c671f15d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:00 devstack sudo[90986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:33:00 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2f1260-64b8-4eb1-9c00-8ee8ce2bfd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e90b7b4e-c10d-4629-ae05-e31e601078df', 'volume_name': 'volume-e90b7b4e-c10d-4629-ae05-e31e601078df', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7fc56a0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25cb5c0-8605-4f5d-9f4c-94d9bebf42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25cb5c0-8605-4f5d-9f4c-94d9bebf42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2b4fb0-bbc9-4d57-a7d1-77183d2685ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:00 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Volume e90b7b4e-c10d-4629-ae05-e31e601078df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e90b7b4e-c10d-4629-ae05-e31e601078df', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7fc56a0>}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Trying to clone e90b7b4e-c10d-4629-ae05-e31e601078df from image 5bde2f08-ba6c-4285-b385-cf604fce5707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:33:00 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:33:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Deleted volume successfully.
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a8b490e3-615b-4b8e-bec3-3ccfcfcd9010 tempest-TaggedAttachmentsTest-1455610019 None] Lock "cinder-773a324e-543f-43df-8332-f530a1880f35-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:33:00 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac6a1a7-270c-4005-bdd0-af952148f32b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:00 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD
Sep 29 16:33:00 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:01 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 is fetched for user bf901491aee047c3a6d2feec5d811b5c. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9245d653-50f0-4f64-bbdc-b7f3f6d9bd57]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:01 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD
Sep 29 16:33:01 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:01 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1016699988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90b7b4e-c10d-4629-ae05-e31e601078df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9e2d0f7f47485297418b0b06b92a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:59Z,use_quota=True,user_id='bf901491aee047c3a6d2feec5d811b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Creating volume e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:33:01 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:33:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:01 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1073741824
Sep 29 16:33:01 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:02 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1073741824" returned: 0 in 0.551s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=58,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:02 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df
Sep 29 16:33:02 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:02 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Attempting download of 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume e90b7b4e-c10d-4629-ae05-e31e601078df. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82d157-e243-4528-915a-c7e6ad82f692]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:02 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii
Sep 29 16:33:02 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:02 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii" returned: 0 in 0.347s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:03 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii
Sep 29 16:33:03 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:03 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii" returned: 1 in 0.383s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_fk_u6tii' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a69f7-8d14-4197-ab8f-dd9a858037b3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:03 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD
Sep 29 16:33:03 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:03 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] 5bde2f08-ba6c-4285-b385-cf604fce5707 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:33:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:03 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df
Sep 29 16:33:03 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:06 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df" returned: 0 in 2.315s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_f2rak19jdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:33:06 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Converted 112.00 MB image at 48.36 MB/s
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:06 devstack sudo[91054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1G
Sep 29 16:33:06 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:06 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df 1G" returned: 0 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Downloaded image 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume e90b7b4e-c10d-4629-ae05-e31e601078df successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 for user bf901491aee047c3a6d2feec5d811b5c is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Marking volume e90b7b4e-c10d-4629-ae05-e31e601078df as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Copying metadata from image 5bde2f08-ba6c-4285-b385-cf604fce5707 to e90b7b4e-c10d-4629-ae05-e31e601078df. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Creating volume glance metadata for volume e90b7b4e-c10d-4629-ae05-e31e601078df backed by image 5bde2f08-ba6c-4285-b385-cf604fce5707 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2b4fb0-bbc9-4d57-a7d1-77183d2685ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90b7b4e-c10d-4629-ae05-e31e601078df', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7fc56a0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6851fc11-46c8-4ccc-81f7-fa83a1f42636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Volume volume-e90b7b4e-c10d-4629-ae05-e31e601078df (e90b7b4e-c10d-4629-ae05-e31e601078df): created successfully
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6851fc11-46c8-4ccc-81f7-fa83a1f42636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Flow 'volume_create_manager' (b58fb84e-e748-43d1-87fd-27269601b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a99e5f22-0bb4-412b-a749-088b92071df9 tempest-ServerActionsTestOtherA-1887375856 None] Created volume successfully.
Sep 29 16:33:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-209c6dc2-5f9c-4f10-a7e0-79f0666c3d08 req-36cf59dd-d4cb-4815-8d83-4b8659fc3aa5 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-209c6dc2-5f9c-4f10-a7e0-79f0666c3d08 req-36cf59dd-d4cb-4815-8d83-4b8659fc3aa5 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-209c6dc2-5f9c-4f10-a7e0-79f0666c3d08 req-36cf59dd-d4cb-4815-8d83-4b8659fc3aa5 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-209c6dc2-5f9c-4f10-a7e0-79f0666c3d08 req-36cf59dd-d4cb-4815-8d83-4b8659fc3aa5 tempest-ServerActionsTestOtherA-1887375856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-e90b7b4e-c10d-4629-ae05-e31e601078df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '524ab84a-809b-47ce-bd4f-4445722f5320', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:33:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-209c6dc2-5f9c-4f10-a7e0-79f0666c3d08 req-36cf59dd-d4cb-4815-8d83-4b8659fc3aa5 tempest-ServerActionsTestOtherA-1887375856 None] attachment_update completed successfully.
Sep 29 16:33:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-0238337b-563c-4709-a560-2dc76764e681 req-15d0e530-5fdb-4978-8a45-9767f4292213 tempest-AttachVolumeTestJSON-1576357736 None] Terminate volume connection completed successfully.
Sep 29 16:33:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-0238337b-563c-4709-a560-2dc76764e681 req-15d0e530-5fdb-4978-8a45-9767f4292213 tempest-AttachVolumeTestJSON-1576357736 None] Deleting attachment a00d70cd-07cb-4942-a65b-a9d0bee504f9. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:33:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-82dd8126-2c65-4e35-9470-b41b54130528 tempest-GroupsTest-1305594701 None] Group tempest-Group1-786595263: creating
Sep 29 16:33:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-82dd8126-2c65-4e35-9470-b41b54130528 tempest-GroupsTest-1305594701 None] Group tempest-Group1-786595263: created successfully
Sep 29 16:33:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-82dd8126-2c65-4e35-9470-b41b54130528 tempest-GroupsTest-1305594701 None] Create group completed successfully.
Sep 29 16:33:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f385315c-4864-48ed-baf6-e5812043bbe9 tempest-GroupsTest-1305594701 None] Group tempest-Group2-1773078316: creating
Sep 29 16:33:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f385315c-4864-48ed-baf6-e5812043bbe9 tempest-GroupsTest-1305594701 None] Group tempest-Group2-1773078316: created successfully
Sep 29 16:33:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f385315c-4864-48ed-baf6-e5812043bbe9 tempest-GroupsTest-1305594701 None] Create group completed successfully.
Sep 29 16:33:22 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:33:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (bd56295b-f26b-464f-8de4-6aeb8eb93886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b0556-29eb-40b5-8aac-0e97b93d30ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b0556-29eb-40b5-8aac-0e97b93d30ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-278269057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4d2b1e5-a3b3-4cd8-9d2a-9ed993e8d69d,host='devstack@QuobyteHD#QuobyteHD',id=0cabb59d-565a-438f-b8c8-e8855295e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:23Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06540a27-134f-49d0-b521-ede2fdfa80b6),volume_type_id=06540a27-134f-49d0-b521-ede2fdfa80b6)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e5c1b0-8921-45da-a85d-dc386183580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e5c1b0-8921-45da-a85d-dc386183580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89684da8-3782-4367-92bd-b450eb0b0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89684da8-3782-4367-92bd-b450eb0b0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cabb59d-565a-438f-b8c8-e8855295e293', 'volume_name': 'volume-0cabb59d-565a-438f-b8c8-e8855295e293', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d667a2e4-c51e-446d-ab7d-d84c4c1b84e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d667a2e4-c51e-446d-ab7d-d84c4c1b84e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f0849a-2deb-4f1d-a9ac-5618bf28d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Volume 0cabb59d-565a-438f-b8c8-e8855295e293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cabb59d-565a-438f-b8c8-e8855295e293', 'volume_size': 1}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d4d2b1e5-a3b3-4cd8-9d2a-9ed993e8d69d,created_at=2026-09-29T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-278269057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4d2b1e5-a3b3-4cd8-9d2a-9ed993e8d69d,host='devstack@QuobyteHD#QuobyteHD',id=0cabb59d-565a-438f-b8c8-e8855295e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:23Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06540a27-134f-49d0-b521-ede2fdfa80b6),volume_type_id=06540a27-134f-49d0-b521-ede2fdfa80b6)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Creating volume 0cabb59d-565a-438f-b8c8-e8855295e293 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:33:23 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:33:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:23 devstack sudo[91698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 1073741824
Sep 29 16:33:23 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:24 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 1073741824" returned: 0 in 1.052s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:24 devstack sudo[91705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293
Sep 29 16:33:24 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:25 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293" returned: 0 in 0.773s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f0849a-2deb-4f1d-a9ac-5618bf28d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cabb59d-565a-438f-b8c8-e8855295e293', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42044334-5299-4ccf-adbf-db7ac49367ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:25 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Volume volume-0cabb59d-565a-438f-b8c8-e8855295e293 (0cabb59d-565a-438f-b8c8-e8855295e293): created successfully
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42044334-5299-4ccf-adbf-db7ac49367ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (bd56295b-f26b-464f-8de4-6aeb8eb93886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-74d0e2ea-4733-4e1b-8761-96fd88b553ef tempest-GroupsTest-1305594701 None] Created volume successfully.
Sep 29 16:33:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Acquiring lock "cinder-quobyte-0cabb59d-565a-438f-b8c8-e8855295e293" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:33:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-0cabb59d-565a-438f-b8c8-e8855295e293" acquired by "delete_volume" :: waited 0.089s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:33:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d213a9b3-9be1-48bd-b73e-3ddc4c8602f2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:27 devstack sudo[91713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293
Sep 29 16:33:27 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:28 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293" returned: 0 in 0.929s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:28 devstack sudo[91718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293
Sep 29 16:33:28 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:29 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0cabb59d-565a-438f-b8c8-e8855295e293" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-0cabb59d-565a-438f-b8c8-e8855295e293" released by "delete_volume" :: held 1.638s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Created reservations ['5ba1c0a4-3539-437e-8911-9def31d96e7f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:29 devstack cinder-volume[86843]: WARNING cinder.quota [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-525850942 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-525850942, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:33:29 devstack cinder-volume[86843]: WARNING cinder.quota [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-525850942 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-525850942, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Created reservations ['cd71f3ef-4ff1-433c-8559-8b3e2eca4247', 'e3337a2d-b5bd-42b1-9451-a441134064fc', '7f1f7a7a-1773-44cb-a396-aaf43ae01d59', '4ae74fba-9e01-4312-ac98-5e8692bb1fbb'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:29 devstack sudo[91721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:33:29 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Created reservations ['ed3aff0d-b4d9-4c7c-90a3-2880dc78815a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:30 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.904s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:33:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f4e50d1b-dd22-4ac4-a728-9b7d6afcbd80 tempest-GroupsTest-1305594701 None] Delete group completed successfully.
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:30 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:33:30 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:31 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.528s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:31 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:33:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-67ec1a5d-80e6-4ef5-8e1a-b19fadaf5bd8 tempest-GroupsTest-1305594701 None] Delete group completed successfully.
Sep 29 16:33:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-60c4e2a1-a42f-428f-8139-07afe32cb22c tempest-GroupsTest-1305594701 None] Group tempest-GroupsTest-Group-1313312628: creating
Sep 29 16:33:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-60c4e2a1-a42f-428f-8139-07afe32cb22c tempest-GroupsTest-1305594701 None] Group tempest-GroupsTest-Group-1313312628: created successfully
Sep 29 16:33:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-60c4e2a1-a42f-428f-8139-07afe32cb22c tempest-GroupsTest-1305594701 None] Create group completed successfully.
Sep 29 16:33:34 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (d624ef41-b03c-49d5-a986-e3bd883b9d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dee83d-ef53-4e9b-b0cf-8e768ab9367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dee83d-ef53-4e9b-b0cf-8e768ab9367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283642939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,host='devstack@QuobyteHD#QuobyteHD',id=e7c27fa5-3c93-4e23-b5b3-13f77a437536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:35Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4),volume_type_id=84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e94c9a0-f303-4723-ab26-6e91ccb57f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e94c9a0-f303-4723-ab26-6e91ccb57f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6ea571-5465-4fdd-bed4-0ffe6dd1fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6ea571-5465-4fdd-bed4-0ffe6dd1fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c27fa5-3c93-4e23-b5b3-13f77a437536', 'volume_name': 'volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a61375-fde4-4183-a6aa-5d0ee4ba7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a61375-fde4-4183-a6aa-5d0ee4ba7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00eb23-075b-4073-b7d5-54f5f223d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Volume e7c27fa5-3c93-4e23-b5b3-13f77a437536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536', 'volume_size': 1}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,created_at=2026-09-29T14:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283642939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,host='devstack@QuobyteHD#QuobyteHD',id=e7c27fa5-3c93-4e23-b5b3-13f77a437536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:35Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4),volume_type_id=84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Creating volume e7c27fa5-3c93-4e23-b5b3-13f77a437536 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:33:35 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:35 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 1073741824
Sep 29 16:33:35 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-15cb6015-52d2-43bc-8b21-fb2cb1d06a74 tempest-ServerActionsTestOtherA-1887375856 None] Terminate volume connection completed successfully.
Sep 29 16:33:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-15cb6015-52d2-43bc-8b21-fb2cb1d06a74 tempest-ServerActionsTestOtherA-1887375856 None] Deleting attachment 524ab84a-809b-47ce-bd4f-4445722f5320. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:33:36 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 1073741824" returned: 0 in 1.026s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:36 devstack sudo[91827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536
Sep 29 16:33:36 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:36 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536" returned: 0 in 0.481s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00eb23-075b-4073-b7d5-54f5f223d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7363ac41-5ee7-4160-afee-064c0f0a3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:36 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Volume volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 (e7c27fa5-3c93-4e23-b5b3-13f77a437536): created successfully
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7363ac41-5ee7-4160-afee-064c0f0a3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (d624ef41-b03c-49d5-a986-e3bd883b9d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:36 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bd7673c4-a16a-4d76-8726-c4976a329338 tempest-GroupsTest-1305594701 None] Created volume successfully.
Sep 29 16:33:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-aed35475-9e15-43f4-a382-cdba0eb87ecb tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-aed35475-9e15-43f4-a382-cdba0eb87ecb tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-aed35475-9e15-43f4-a382-cdba0eb87ecb tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-aed35475-9e15-43f4-a382-cdba0eb87ecb tempest-ServerActionsTestOtherA-1887375856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-e90b7b4e-c10d-4629-ae05-e31e601078df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40972619-3698-4171-9178-fe38bc34b968', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:33:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-b72eed65-26d3-433c-bff9-9eaac685e681 req-aed35475-9e15-43f4-a382-cdba0eb87ecb tempest-ServerActionsTestOtherA-1887375856 None] attachment_update completed successfully.
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (427094ed-97e2-459e-bacf-794b93e1d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd5476d-f7ba-4083-9217-c2a22b22de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd5476d-f7ba-4083-9217-c2a22b22de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956748275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,host='devstack@QuobyteHD#QuobyteHD',id=df16a227-c052-44d7-b8a4-59c229ea6d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:39Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4),volume_type_id=84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8450307-bba0-412b-a0a5-4e5ea52cd3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8450307-bba0-412b-a0a5-4e5ea52cd3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfe0ae6-e296-4abb-9c3a-9118862827ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfe0ae6-e296-4abb-9c3a-9118862827ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df16a227-c052-44d7-b8a4-59c229ea6d79', 'volume_name': 'volume-df16a227-c052-44d7-b8a4-59c229ea6d79', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7969c66f-bb1b-479a-86ca-4aa68443243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7969c66f-bb1b-479a-86ca-4aa68443243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fc51f9-53cb-4937-aa64-ee839a1332da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Volume df16a227-c052-44d7-b8a4-59c229ea6d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df16a227-c052-44d7-b8a4-59c229ea6d79', 'volume_size': 1}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,created_at=2026-09-29T14:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956748275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=da80122f-5eaa-4cc5-843f-ab69e4f5329f,host='devstack@QuobyteHD#QuobyteHD',id=df16a227-c052-44d7-b8a4-59c229ea6d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d30f31343b417b81198956f0b25236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:39Z,use_quota=True,user_id='c8e9867cf08e40bd99c932d77a525b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4),volume_type_id=84c8f9b7-916d-4e8e-b0d6-f846f5eb5dd4)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Creating volume df16a227-c052-44d7-b8a4-59c229ea6d79 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:33:39 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:39 devstack sudo[92273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 1073741824
Sep 29 16:33:39 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:39 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 1073741824" returned: 0 in 0.568s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:39 devstack sudo[92293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79
Sep 29 16:33:39 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:40 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79" returned: 0 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fc51f9-53cb-4937-aa64-ee839a1332da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df16a227-c052-44d7-b8a4-59c229ea6d79', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c2116d-fd73-421a-95fc-d7ce151819dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:33:40 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Volume volume-df16a227-c052-44d7-b8a4-59c229ea6d79 (df16a227-c052-44d7-b8a4-59c229ea6d79): created successfully
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c2116d-fd73-421a-95fc-d7ce151819dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:33:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Flow 'volume_create_manager' (427094ed-97e2-459e-bacf-794b93e1d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:33:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-368b239f-c52d-40a4-b226-5ca344cd6b17 tempest-GroupsTest-1305594701 None] Created volume successfully.
Sep 29 16:33:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-799e2681-e018-4c2f-9713-08cd6a28c2cf tempest-GroupsTest-1305594701 None] Update group completed successfully.
Sep 29 16:33:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-59ba9a32-422d-40c1-b955-c56a72f4c7b8 tempest-GroupsTest-1305594701 None] Update group completed successfully.
Sep 29 16:33:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Acquiring lock "cinder-quobyte-df16a227-c052-44d7-b8a4-59c229ea6d79" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:33:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-df16a227-c052-44d7-b8a4-59c229ea6d79" acquired by "delete_volume" :: waited 0.098s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:33:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a7bce7-0350-48fb-bcaa-37e468d9c76a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:45 devstack sudo[92347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79
Sep 29 16:33:45 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:46 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79" returned: 0 in 0.715s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:46 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79
Sep 29 16:33:46 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:46 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df16a227-c052-44d7-b8a4-59c229ea6d79" returned: 0 in 0.424s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-df16a227-c052-44d7-b8a4-59c229ea6d79" released by "delete_volume" :: held 1.254s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Acquiring lock "cinder-quobyte-e7c27fa5-3c93-4e23-b5b3-13f77a437536" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-e7c27fa5-3c93-4e23-b5b3-13f77a437536" acquired by "delete_volume" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64c772d-30f4-4062-806b-9934207c63a8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:33:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:47 devstack sudo[92359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536
Sep 29 16:33:47 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:47 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536" returned: 0 in 0.848s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:47 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536
Sep 29 16:33:47 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:48 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7c27fa5-3c93-4e23-b5b3-13f77a437536" returned: 0 in 0.643s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "cinder-quobyte-e7c27fa5-3c93-4e23-b5b3-13f77a437536" released by "delete_volume" :: held 1.593s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:33:48 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Created reservations ['02ad8e7e-2bac-4737-bf1e-ab064b304e46'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:48 devstack cinder-volume[86843]: WARNING cinder.quota [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-84710833 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-84710833, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:33:48 devstack cinder-volume[86843]: WARNING cinder.quota [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-84710833 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-84710833, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:33:48 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Created reservations ['ae18f34d-ba8b-4ece-9afc-ebbb3f6a192d', '63dc3ac8-f90d-4e84-88b7-e393cc1b784f', 'de4cb87d-038b-46b3-b318-6723393a7e01', '9e0054cc-9838-4558-b62d-4c4420a72b3d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Created reservations ['49187599-9431-4d2b-a12f-bcd0c80804a1', '66349bc2-b33d-4c39-a235-10f43915613b', '45ca3c9d-204a-4157-8317-fc591e5d5ee1', '70532ef7-af6b-4a3b-a7a4-17c56d1ac2ae'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:49 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:33:49 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:50 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.788s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:50 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:33:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cf5216e1-f955-428b-a882-b5885af64d7e tempest-GroupsTest-1305594701 None] Delete group completed successfully.
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:33:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:33:53 devstack sudo[92494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:33:53 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:33:54 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root
Sep 29 16:33:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.607s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:33:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:33:54 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:33:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:33:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:33:59 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=50,cinder:SELECT=65,cinder:INSERT=15,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:33:59 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=56,cinder:SELECT=62,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Flow 'volume_create_manager' (ea415e0b-2c1b-4a8e-afa3-85195f44962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258679a0-684d-4d0f-b978-de28b627b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258679a0-684d-4d0f-b978-de28b627b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-113343835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab83ce3-9b9d-4ab0-953d-4cceefede1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704b59ac4c7940a6b270913778c2f0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:00Z,use_quota=True,user_id='4f4e1ce612534b18b44a005497fa08a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e22dae62-f485-46eb-9c8f-41d60fff2f5e),volume_type_id=e22dae62-f485-46eb-9c8f-41d60fff2f5e)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8034e816-c9fb-482d-9313-11aba58e6bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8034e816-c9fb-482d-9313-11aba58e6bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d554777-c512-4ed4-b096-98c502d7ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d554777-c512-4ed4-b096-98c502d7ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab83ce3-9b9d-4ab0-953d-4cceefede1fa', 'volume_name': 'volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81dbfff-a12c-40ac-a1bf-a6cfde986a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81dbfff-a12c-40ac-a1bf-a6cfde986a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d52676-ce9b-4ae2-9896-d30a41e1644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:00 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Volume 7ab83ce3-9b9d-4ab0-953d-4cceefede1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa', 'volume_size': 1}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-113343835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab83ce3-9b9d-4ab0-953d-4cceefede1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704b59ac4c7940a6b270913778c2f0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:00Z,use_quota=True,user_id='4f4e1ce612534b18b44a005497fa08a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e22dae62-f485-46eb-9c8f-41d60fff2f5e),volume_type_id=e22dae62-f485-46eb-9c8f-41d60fff2f5e)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Creating volume 7ab83ce3-9b9d-4ab0-953d-4cceefede1fa {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:34:00 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:00 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa 1073741824
Sep 29 16:34:00 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:00 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa 1073741824" returned: 0 in 0.546s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:00 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa
Sep 29 16:34:00 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:01 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d52676-ce9b-4ae2-9896-d30a41e1644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93372392-602a-4390-aa6f-2058204c1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Volume volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa (7ab83ce3-9b9d-4ab0-953d-4cceefede1fa): created successfully
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93372392-602a-4390-aa6f-2058204c1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Flow 'volume_create_manager' (ea415e0b-2c1b-4a8e-afa3-85195f44962c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3660d0bf-3edb-4d79-82e2-bd72e0e2b4e5 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Created volume successfully.
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:02 devstack sudo[92547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:02 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:03 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.328s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:03 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6133a83f-5805-44ee-81e6-2553711dfba0 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Retype volume completed successfully.
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "cinder-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "cinder-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "cinder-quobyte-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "cinder-quobyte-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d4e65-b9d1-45d9-9442-bfd50b051605]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:04 devstack sudo[92565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa
Sep 29 16:34:04 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:04 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" returned: 0 in 0.460s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:04 devstack sudo[92573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa
Sep 29 16:34:04 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:05 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" returned: 0 in 0.305s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "cinder-quobyte-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa" released by "delete_volume" :: held 0.827s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:05 devstack cinder-volume[86843]: WARNING cinder.quota [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:34:05 devstack cinder-volume[86843]: WARNING cinder.quota [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Created reservations ['7883dae6-4867-4dee-b4ec-13dfd3f7909d', '6b3ba9f6-1bcf-4a3f-8a05-5718b8eaf7fc', 'a4251119-325b-405c-ad06-20d89dfcbb9f', '62561d58-b53c-4429-a1aa-482002b9eabc'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:05 devstack sudo[92598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:05 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:05 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.431s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Deleted volume successfully.
Sep 29 16:34:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cb4d1ac4-a239-47bf-91f3-87c12be374c2 tempest-VolumeRetypeWithoutMigrationTest-349759166 None] Lock "cinder-7ab83ce3-9b9d-4ab0-953d-4cceefede1fa-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:15 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:34:15 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Flow 'volume_create_manager' (e3d78055-04e2-425e-bbb0-053b81f78124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f08812-adf8-4cce-b9f2-a887a9864f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f08812-adf8-4cce-b9f2-a887a9864f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1755310967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bde86e7-9437-415e-9735-209db829e842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995c06b0178f4ba2a062c653b49a773c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:17Z,use_quota=True,user_id='0bf0540a0e804d5a99c73550878517de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c267cb0-1180-4fa1-aba3-48e0b74c38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c267cb0-1180-4fa1-aba3-48e0b74c38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eee12f-84dc-432e-bd77-c5b97d0ac81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eee12f-84dc-432e-bd77-c5b97d0ac81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bde86e7-9437-415e-9735-209db829e842', 'volume_name': 'volume-3bde86e7-9437-415e-9735-209db829e842', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2d9e0e-84ee-4919-a3dd-e8ad3475c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2d9e0e-84ee-4919-a3dd-e8ad3475c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c86c21b-f684-4922-93ba-c083bcca540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Volume 3bde86e7-9437-415e-9735-209db829e842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bde86e7-9437-415e-9735-209db829e842', 'volume_size': 1}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1755310967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bde86e7-9437-415e-9735-209db829e842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995c06b0178f4ba2a062c653b49a773c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:17Z,use_quota=True,user_id='0bf0540a0e804d5a99c73550878517de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Creating volume 3bde86e7-9437-415e-9735-209db829e842 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:34:16 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:34:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:16 devstack sudo[92724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 1073741824
Sep 29 16:34:16 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:17 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 1073741824" returned: 0 in 0.618s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:17 devstack sudo[92733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842
Sep 29 16:34:17 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:17 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c86c21b-f684-4922-93ba-c083bcca540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bde86e7-9437-415e-9735-209db829e842', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2676ef89-9dc4-4380-86ce-4de87da224e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Volume volume-3bde86e7-9437-415e-9735-209db829e842 (3bde86e7-9437-415e-9735-209db829e842): created successfully
Sep 29 16:34:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2676ef89-9dc4-4380-86ce-4de87da224e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Flow 'volume_create_manager' (e3d78055-04e2-425e-bbb0-053b81f78124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-aaba253d-79c2-49d7-be81-17209408ef72 tempest-AttachVolumeShelveTestJSON-1933094138 None] Created volume successfully.
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Flow 'volume_create_manager' (ea0163d8-a5b2-4b2f-a736-13314460ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0b6828-e90e-4251-916a-a64288f78685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0b6828-e90e-4251-916a-a64288f78685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1896514264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83188f12-b705-434f-a34b-31a4a81a36e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1370fe08d984a19ade4655de871058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:20Z,use_quota=True,user_id='4e28ab25482f436db3f6c1b82f6d95d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0192eed9-e413-40bf-a9d8-3a4aac92fef0),volume_type_id=0192eed9-e413-40bf-a9d8-3a4aac92fef0)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f76ee9e-ff6a-40a9-9b4d-f37e50c903a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f76ee9e-ff6a-40a9-9b4d-f37e50c903a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2e54ae-8211-41bd-8b17-c81e4ac17158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2e54ae-8211-41bd-8b17-c81e4ac17158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83188f12-b705-434f-a34b-31a4a81a36e1', 'volume_name': 'volume-83188f12-b705-434f-a34b-31a4a81a36e1', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ddb8cb-5ad0-4843-96ea-5b2b6521b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ddb8cb-5ad0-4843-96ea-5b2b6521b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af8d095-7fec-45db-8c66-36a06f034e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Volume 83188f12-b705-434f-a34b-31a4a81a36e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83188f12-b705-434f-a34b-31a4a81a36e1', 'volume_size': 1}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1896514264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83188f12-b705-434f-a34b-31a4a81a36e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1370fe08d984a19ade4655de871058d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:20Z,use_quota=True,user_id='4e28ab25482f436db3f6c1b82f6d95d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0192eed9-e413-40bf-a9d8-3a4aac92fef0),volume_type_id=0192eed9-e413-40bf-a9d8-3a4aac92fef0)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Creating volume 83188f12-b705-434f-a34b-31a4a81a36e1 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:34:20 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:20 devstack sudo[92743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 1073741824
Sep 29 16:34:20 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:20 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 1073741824" returned: 0 in 0.501s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:20 devstack sudo[92756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1
Sep 29 16:34:20 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:21 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1" returned: 0 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af8d095-7fec-45db-8c66-36a06f034e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83188f12-b705-434f-a34b-31a4a81a36e1', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169eaad-b4f6-4828-be59-3701b0b14cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Volume volume-83188f12-b705-434f-a34b-31a4a81a36e1 (83188f12-b705-434f-a34b-31a4a81a36e1): created successfully
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169eaad-b4f6-4828-be59-3701b0b14cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Flow 'volume_create_manager' (ea0163d8-a5b2-4b2f-a736-13314460ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c33ae92d-0345-4240-b97b-b34ae6d513a5 tempest-VolumeTypesAccessTest-234555043 None] Created volume successfully.
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Acquiring lock "cinder-83188f12-b705-434f-a34b-31a4a81a36e1-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "cinder-83188f12-b705-434f-a34b-31a4a81a36e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Acquiring lock "cinder-quobyte-83188f12-b705-434f-a34b-31a4a81a36e1" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "cinder-quobyte-83188f12-b705-434f-a34b-31a4a81a36e1" acquired by "delete_volume" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7fca19-adb7-4671-94e4-0394a6bf0366]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:22 devstack sudo[92800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1
Sep 29 16:34:22 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:22 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1" returned: 0 in 0.394s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:22 devstack sudo[92805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1
Sep 29 16:34:22 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:23 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83188f12-b705-434f-a34b-31a4a81a36e1" returned: 0 in 0.267s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "cinder-quobyte-83188f12-b705-434f-a34b-31a4a81a36e1" released by "delete_volume" :: held 0.707s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:23 devstack cinder-volume[86843]: WARNING cinder.quota [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1376106992 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1376106992, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:34:23 devstack cinder-volume[86843]: WARNING cinder.quota [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376106992 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376106992, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Created reservations ['98ec22fd-da73-4089-b258-f089982f0b57', 'b95730e1-3bfc-4ad7-8ca6-6d66ae41a77a', 'c556903c-6563-46fd-a496-f4912ecf943a', '53a11583-590f-438d-b527-6da5d5a702ac'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:23 devstack sudo[92809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:23 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:23 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Deleted volume successfully.
Sep 29 16:34:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e05d97a4-16f6-4950-abca-822f351d069e tempest-VolumeTypesAccessTest-234555043 None] Lock "cinder-83188f12-b705-434f-a34b-31a4a81a36e1-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-127e6474-3541-4cde-a83a-32bfba90d92d req-8edc0b0b-9d8b-4c87-966f-cd5a5a557628 tempest-ServerActionsTestOtherA-1887375856 None] Terminate volume connection completed successfully.
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-127e6474-3541-4cde-a83a-32bfba90d92d req-8edc0b0b-9d8b-4c87-966f-cd5a5a557628 tempest-ServerActionsTestOtherA-1887375856 None] Deleting attachment 40972619-3698-4171-9178-fe38bc34b968. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "cinder-e90b7b4e-c10d-4629-ae05-e31e601078df-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-e90b7b4e-c10d-4629-ae05-e31e601078df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "cinder-quobyte-e90b7b4e-c10d-4629-ae05-e31e601078df" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-quobyte-e90b7b4e-c10d-4629-ae05-e31e601078df" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f7ade5-bf43-4a9d-85b6-918f74c160ab]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:27 devstack sudo[92848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df
Sep 29 16:34:27 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:27 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df" returned: 0 in 0.522s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:27 devstack sudo[92855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df
Sep 29 16:34:27 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:28 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e90b7b4e-c10d-4629-ae05-e31e601078df" returned: 0 in 0.691s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-quobyte-e90b7b4e-c10d-4629-ae05-e31e601078df" released by "delete_volume" :: held 1.300s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.quota [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Created reservations ['737106a9-bcf2-45a0-82a1-fcb9efb13274', '5fa5ce71-17c3-44df-975c-1827343e37ac', 'a53e32f1-d8cc-4cae-b791-0375a56c2fab', '4e03c996-d9ac-47c1-95b9-7c25dd15947f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:28 devstack sudo[92873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:28 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:28 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.manager [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Deleted volume successfully.
Sep 29 16:34:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-127e6474-3541-4cde-a83a-32bfba90d92d req-2c3178f2-9d96-40c4-b272-24e2c0e41933 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-e90b7b4e-c10d-4629-ae05-e31e601078df-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "cinder-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "cinder-quobyte-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-quobyte-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffe4ab2-6f0c-49bb-a96b-8a8a7fb0faa5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:29 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca
Sep 29 16:34:29 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:29 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" returned: 0 in 0.427s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:29 devstack sudo[92881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca
Sep 29 16:34:29 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:30 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" returned: 0 in 0.411s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-quobyte-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca" released by "delete_volume" :: held 0.905s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Created reservations ['800d398e-6d7f-4f04-bbfb-8055d8289bf9', '76e8551c-7f2c-4678-8bd3-721106827604', '8385f312-671f-43ea-8fb4-7a51f1846f8a', '8a022fdb-c503-417c-9d48-7b0d9952b099'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:30 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:30 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:30 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Deleted volume successfully.
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8d26a8b-e458-4ffe-bfb1-6e3895c267c1 tempest-ServerActionsTestOtherA-1887375856 None] Lock "cinder-1d89b93e-84b8-40b6-ad1b-ee63bc2aa8ca-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-e6622041-cc6d-450b-8bf1-83f699b6c9c1 req-af9f004c-826c-4f0c-bceb-c3f6ff8d287c tempest-AttachVolumeShelveTestJSON-1933094138 None] No connector for attachment 5ac41785-3aee-48da-851a-590d0efeeb5b; skipping storage backend terminate_connection call. {{(pid=86843) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 29 16:34:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-e6622041-cc6d-450b-8bf1-83f699b6c9c1 req-af9f004c-826c-4f0c-bceb-c3f6ff8d287c tempest-AttachVolumeShelveTestJSON-1933094138 None] Deleting attachment 5ac41785-3aee-48da-851a-590d0efeeb5b. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (89839303-a758-4e56-b8b4-59c267323481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b8531c-2e67-4331-9d96-a631d08f4244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b8531c-2e67-4331-9d96-a631d08f4244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-10957069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cf6cd5-3f07-445a-be57-1080d628e8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:32Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d09a8e-1ef1-4abe-a099-21bb83edafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d09a8e-1ef1-4abe-a099-21bb83edafff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76832b1a-87eb-475e-9674-ff1b8be0ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76832b1a-87eb-475e-9674-ff1b8be0ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cf6cd5-3f07-445a-be57-1080d628e8f7', 'volume_name': 'volume-68cf6cd5-3f07-445a-be57-1080d628e8f7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6d862-6a2e-4e14-a24b-0e8e9cf27804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa6d862-6a2e-4e14-a24b-0e8e9cf27804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21273c8c-e061-47bb-b8f2-7f1eb8f6d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Volume 68cf6cd5-3f07-445a-be57-1080d628e8f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cf6cd5-3f07-445a-be57-1080d628e8f7', 'volume_size': 1}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-10957069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cf6cd5-3f07-445a-be57-1080d628e8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:32Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Creating volume 68cf6cd5-3f07-445a-be57-1080d628e8f7 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:34:32 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:32 devstack sudo[92893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 1073741824
Sep 29 16:34:32 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:32 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 1073741824" returned: 0 in 0.796s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:32 devstack sudo[92922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7
Sep 29 16:34:32 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:33 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7" returned: 0 in 0.531s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21273c8c-e061-47bb-b8f2-7f1eb8f6d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cf6cd5-3f07-445a-be57-1080d628e8f7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b16f8-dec9-42b5-8e85-a97dc43c3937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Volume volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 (68cf6cd5-3f07-445a-be57-1080d628e8f7): created successfully
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b16f8-dec9-42b5-8e85-a97dc43c3937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (89839303-a758-4e56-b8b4-59c267323481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-425dc257-1273-4d83-99ac-ad8fd24becb0 tempest-AttachVolumeTestJSON-1576357736 None] Created volume successfully.
Sep 29 16:34:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-39f2ed3a-db69-490d-b003-250d86dcceb4 req-5a3b2759-59ce-415b-b0c5-ada503b1f7b0 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-39f2ed3a-db69-490d-b003-250d86dcceb4 req-5a3b2759-59ce-415b-b0c5-ada503b1f7b0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-39f2ed3a-db69-490d-b003-250d86dcceb4 req-5a3b2759-59ce-415b-b0c5-ada503b1f7b0 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-39f2ed3a-db69-490d-b003-250d86dcceb4 req-5a3b2759-59ce-415b-b0c5-ada503b1f7b0 tempest-AttachVolumeTestJSON-1576357736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-68cf6cd5-3f07-445a-be57-1080d628e8f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c91db146-7338-4a86-963e-87aa17c9c794', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:34:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-39f2ed3a-db69-490d-b003-250d86dcceb4 req-5a3b2759-59ce-415b-b0c5-ada503b1f7b0 tempest-AttachVolumeTestJSON-1576357736 None] attachment_update completed successfully.
Sep 29 16:34:37 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:34:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (3d0649e3-5224-484d-be19-8069ce4899c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6d431-6eff-49a1-bcd9-f42acdf1304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6d431-6eff-49a1-bcd9-f42acdf1304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-42050722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6eb979-bf4d-47a0-b0dd-1e2fba695439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:38Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1489c6f6-b33f-45d1-af6a-d14efc7229c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1489c6f6-b33f-45d1-af6a-d14efc7229c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0ed1b1-f00f-4aaa-99ab-3e636c3c1c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0ed1b1-f00f-4aaa-99ab-3e636c3c1c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6eb979-bf4d-47a0-b0dd-1e2fba695439', 'volume_name': 'volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6392fb42-04c8-4655-82f6-3f3224b8e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6392fb42-04c8-4655-82f6-3f3224b8e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7581b6f-3405-4d67-9706-3d0227d344a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Volume be6eb979-bf4d-47a0-b0dd-1e2fba695439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439', 'volume_size': 1}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-42050722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6eb979-bf4d-47a0-b0dd-1e2fba695439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491c97bfcca4638a9c4aa39f39ef782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:38Z,use_quota=True,user_id='99c8dfac01eb457eb971508d4468dfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Creating volume be6eb979-bf4d-47a0-b0dd-1e2fba695439 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:34:38 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:38 devstack sudo[93399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 1073741824
Sep 29 16:34:38 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:38 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 1073741824" returned: 0 in 0.591s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:38 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439
Sep 29 16:34:38 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:39 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439" returned: 0 in 0.384s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7581b6f-3405-4d67-9706-3d0227d344a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d884f-0984-49ec-b6b5-bc809b7bffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:34:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Volume volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 (be6eb979-bf4d-47a0-b0dd-1e2fba695439): created successfully
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6d884f-0984-49ec-b6b5-bc809b7bffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:34:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Flow 'volume_create_manager' (3d0649e3-5224-484d-be19-8069ce4899c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:34:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-77a2e8ee-1d01-46c0-93cf-15bc178242c7 tempest-AttachVolumeTestJSON-1576357736 None] Created volume successfully.
Sep 29 16:34:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ebe2c158-9b9c-4b4d-9c1a-d75afafddbf7 req-8cb46927-3a4f-4a1a-ac32-5f7673c5b5d1 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ebe2c158-9b9c-4b4d-9c1a-d75afafddbf7 req-8cb46927-3a4f-4a1a-ac32-5f7673c5b5d1 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ebe2c158-9b9c-4b4d-9c1a-d75afafddbf7 req-8cb46927-3a4f-4a1a-ac32-5f7673c5b5d1 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-ebe2c158-9b9c-4b4d-9c1a-d75afafddbf7 req-8cb46927-3a4f-4a1a-ac32-5f7673c5b5d1 tempest-AttachVolumeTestJSON-1576357736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cae2cdfb-272a-4fd2-a229-a2898c48d60e', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:34:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-ebe2c158-9b9c-4b4d-9c1a-d75afafddbf7 req-8cb46927-3a4f-4a1a-ac32-5f7673c5b5d1 tempest-AttachVolumeTestJSON-1576357736 None] attachment_update completed successfully.
Sep 29 16:34:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-a4f2436d-38d4-4121-80d1-4351b4403dd3 req-d2afb08d-dfc7-4dff-b881-4ae17a278f63 tempest-AttachVolumeTestJSON-1576357736 None] Terminate volume connection completed successfully.
Sep 29 16:34:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-a4f2436d-38d4-4121-80d1-4351b4403dd3 req-d2afb08d-dfc7-4dff-b881-4ae17a278f63 tempest-AttachVolumeTestJSON-1576357736 None] Deleting attachment c91db146-7338-4a86-963e-87aa17c9c794. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:34:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-82dce217-fbb5-4fea-a5a0-61af618cc44c req-aae6912b-e09f-4b15-9d61-3161c2b3f1f3 tempest-AttachVolumeTestJSON-1576357736 None] Terminate volume connection completed successfully.
Sep 29 16:34:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-82dce217-fbb5-4fea-a5a0-61af618cc44c req-aae6912b-e09f-4b15-9d61-3161c2b3f1f3 tempest-AttachVolumeTestJSON-1576357736 None] Deleting attachment cae2cdfb-272a-4fd2-a229-a2898c48d60e. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:53 devstack sudo[93622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:53 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:53 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:34:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-be6eb979-bf4d-47a0-b0dd-1e2fba695439-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-be6eb979-bf4d-47a0-b0dd-1e2fba695439-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-quobyte-be6eb979-bf4d-47a0-b0dd-1e2fba695439" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-be6eb979-bf4d-47a0-b0dd-1e2fba695439" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d0d17-4d4f-4136-b256-738d0543f9a5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:54 devstack sudo[93625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439
Sep 29 16:34:54 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:55 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439" returned: 0 in 0.617s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:55 devstack sudo[93630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439
Sep 29 16:34:55 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:55 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-be6eb979-bf4d-47a0-b0dd-1e2fba695439" returned: 0 in 0.376s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-be6eb979-bf4d-47a0-b0dd-1e2fba695439" released by "delete_volume" :: held 1.090s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:55 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Created reservations ['70ff0630-4f37-441a-8a78-089f128b4be6', '995ea1e3-e5d4-44ce-b663-3bb596090c79', 'f6129121-09fe-4c91-8fa6-4e07f88c9e15', '00ffa402-aadc-424b-8a79-a6c0e55de2f6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:56 devstack sudo[93633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:56 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:56 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Deleted volume successfully.
Sep 29 16:34:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7d89c7c-f8a9-4f3a-818c-b0ac78f9f2af tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-be6eb979-bf4d-47a0-b0dd-1e2fba695439-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-68cf6cd5-3f07-445a-be57-1080d628e8f7-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-68cf6cd5-3f07-445a-be57-1080d628e8f7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-quobyte-68cf6cd5-3f07-445a-be57-1080d628e8f7" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-68cf6cd5-3f07-445a-be57-1080d628e8f7" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63a9d3-d98f-41d2-b79f-5891da24cc13]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:57 devstack sudo[93636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7
Sep 29 16:34:57 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:57 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7" returned: 0 in 0.474s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:57 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7
Sep 29 16:34:57 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:58 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-68cf6cd5-3f07-445a-be57-1080d628e8f7" returned: 0 in 0.519s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-68cf6cd5-3f07-445a-be57-1080d628e8f7" released by "delete_volume" :: held 1.094s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Created reservations ['274ea8fe-4ad5-4c26-a340-d64ce9b3f0c9', 'be904929-1534-4eb1-ba2d-594fcbf8b245', '4d7f9c78-6125-4e2b-905a-a6c0f5bccafd', 'e0e2e365-fd74-46f3-8128-afa68ae559a2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:34:58 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:34:58 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:34:58 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.384s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:34:58 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:34:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Deleted volume successfully.
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8cb32386-1758-4d04-9113-14f51256989c tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-68cf6cd5-3f07-445a-be57-1080d628e8f7-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-af9d1564-8704-475a-bddb-c8aaf74215d7-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-af9d1564-8704-475a-bddb-c8aaf74215d7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "cinder-quobyte-af9d1564-8704-475a-bddb-c8aaf74215d7" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-af9d1564-8704-475a-bddb-c8aaf74215d7" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ea7ae-6fd3-4ecd-a2fd-f72534802de2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:34:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:00 devstack sudo[93647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7
Sep 29 16:35:00 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:00 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7" returned: 0 in 0.472s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:00 devstack sudo[93653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7
Sep 29 16:35:00 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:00 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-af9d1564-8704-475a-bddb-c8aaf74215d7" returned: 0 in 0.377s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-quobyte-af9d1564-8704-475a-bddb-c8aaf74215d7" released by "delete_volume" :: held 0.923s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Created reservations ['2765300b-74f4-469d-ad32-02a7a95686a4', 'b1b67e7e-c431-426d-865a-d53b394f32b7', '36c7cfd9-a664-4b3e-8d85-610266d82e50', '7fc76c18-be13-4cf8-9415-7533f9c35d73'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:00 devstack sudo[93664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:00 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:01 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.339s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:01 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Deleted volume successfully.
Sep 29 16:35:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de0cdbd2-8c2a-4067-a2c4-db2afe8b1052 tempest-AttachVolumeTestJSON-1576357736 None] Lock "cinder-af9d1564-8704-475a-bddb-c8aaf74215d7-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:10 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=68,cinder:SELECT=54,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:35:11 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=56,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=13 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (54995c89-56f4-402b-ba76-af751b1deb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1e49c-182f-47f1-9681-ceed389fd784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1e49c-182f-47f1-9681-ceed389fd784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1065542085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f6ebdd-67c0-4542-b1f6-ad988aa52973,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:14Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696b1fe-b412-4744-a1d2-a730f64dad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696b1fe-b412-4744-a1d2-a730f64dad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3899751-35a0-4af0-aee9-89b8505fa551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3899751-35a0-4af0-aee9-89b8505fa551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f6ebdd-67c0-4542-b1f6-ad988aa52973', 'volume_name': 'volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7626ef71-41fb-4d29-959f-bcd17491a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7626ef71-41fb-4d29-959f-bcd17491a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d65f86-a887-4f1b-adf8-6becdc7e6961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:13 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Volume b3f6ebdd-67c0-4542-b1f6-ad988aa52973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973', 'volume_size': 1}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1065542085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f6ebdd-67c0-4542-b1f6-ad988aa52973,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:14Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Creating volume b3f6ebdd-67c0-4542-b1f6-ad988aa52973 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:13 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:13 devstack sudo[93730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 1073741824
Sep 29 16:35:13 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:14 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 1073741824" returned: 0 in 0.708s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:14 devstack sudo[93754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973
Sep 29 16:35:14 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:14 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d65f86-a887-4f1b-adf8-6becdc7e6961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb115f0-9bd5-4c8d-874a-fb15e66eca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Volume volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 (b3f6ebdd-67c0-4542-b1f6-ad988aa52973): created successfully
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb115f0-9bd5-4c8d-874a-fb15e66eca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (54995c89-56f4-402b-ba76-af751b1deb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-947eccda-47be-44ac-8bb2-95086d14a66b tempest-VolumesTestJSON-186700603 None] Created volume successfully.
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (1ac2d20d-450c-422d-bcb8-2841d73aa74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4eedd0-6b88-4357-b73d-6d3d32007192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4eedd0-6b88-4357-b73d-6d3d32007192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1169145644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc3574-0a6c-4ca6-ad6e-3898b59a51b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:18Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e0fb69-16c7-4f4c-9fe4-3318221b8157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e0fb69-16c7-4f4c-9fe4-3318221b8157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4516b1a-b32e-4e20-b3a1-7e371b1e49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4516b1a-b32e-4e20-b3a1-7e371b1e49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cc3574-0a6c-4ca6-ad6e-3898b59a51b8', 'volume_name': 'volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53235844-3b2c-4938-b49b-c0c9a9e0413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53235844-3b2c-4938-b49b-c0c9a9e0413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2422699e-da8b-46ab-97b2-38551cf55544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Volume 97cc3574-0a6c-4ca6-ad6e-3898b59a51b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8', 'volume_size': 1}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1169145644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc3574-0a6c-4ca6-ad6e-3898b59a51b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:18Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Creating volume 97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:18 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:18 devstack sudo[93761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 1073741824
Sep 29 16:35:18 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:19 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 1073741824" returned: 0 in 0.692s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:19 devstack sudo[93768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8
Sep 29 16:35:19 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:19 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" returned: 0 in 0.346s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2422699e-da8b-46ab-97b2-38551cf55544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cefe936-c85b-43f4-9f8b-375bc14a4532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:19 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Volume volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 (97cc3574-0a6c-4ca6-ad6e-3898b59a51b8): created successfully
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cefe936-c85b-43f4-9f8b-375bc14a4532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (1ac2d20d-450c-422d-bcb8-2841d73aa74a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-847ea4eb-620e-4767-a6c0-c061e2b9d6a5 tempest-VolumesTestJSON-186700603 None] Created volume successfully.
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (fe19e017-0c63-4b49-9735-66f4cc5df24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7778d2b1-a7fe-42e3-b281-59d713c57ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7778d2b1-a7fe-42e3-b281-59d713c57ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489920394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46102e9-05d0-4acc-8f9a-019642d1ae7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:21Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5304b186-f145-49a6-b9bb-bb1a60df32f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5304b186-f145-49a6-b9bb-bb1a60df32f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900c86f9-1ae9-4eaa-9439-bc53e28abda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900c86f9-1ae9-4eaa-9439-bc53e28abda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46102e9-05d0-4acc-8f9a-019642d1ae7d', 'volume_name': 'volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042caa3-dfba-4452-91d5-e43ec6b3b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5042caa3-dfba-4452-91d5-e43ec6b3b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a3f3d-e785-4d9f-9291-4e2840067761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Volume e46102e9-05d0-4acc-8f9a-019642d1ae7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d', 'volume_size': 1}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489920394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46102e9-05d0-4acc-8f9a-019642d1ae7d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93a014e0ac194352bbaaa6028496f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:21Z,use_quota=True,user_id='9e3410f5e14d4430a532338ac7bf5491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Creating volume e46102e9-05d0-4acc-8f9a-019642d1ae7d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:21 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:21 devstack sudo[93813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d 1073741824
Sep 29 16:35:21 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:22 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d 1073741824" returned: 0 in 0.816s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:22 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d
Sep 29 16:35:22 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:22 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d" returned: 0 in 0.421s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a3f3d-e785-4d9f-9291-4e2840067761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bb521-2488-46c8-a3fe-af6f420b6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Volume volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d (e46102e9-05d0-4acc-8f9a-019642d1ae7d): created successfully
Sep 29 16:35:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bb521-2488-46c8-a3fe-af6f420b6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Flow 'volume_create_manager' (fe19e017-0c63-4b49-9735-66f4cc5df24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b47a441a-8f06-4c90-bb0b-516f0e277327 tempest-VolumesTestJSON-186700603 None] Created volume successfully.
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-e46102e9-05d0-4acc-8f9a-019642d1ae7d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "cinder-e46102e9-05d0-4acc-8f9a-019642d1ae7d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-quobyte-e46102e9-05d0-4acc-8f9a-019642d1ae7d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-e46102e9-05d0-4acc-8f9a-019642d1ae7d" acquired by "delete_volume" :: waited 0.049s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e2728-64e0-4d5e-ab2b-2f45a894ea64]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Acquiring lock "cinder-3bde86e7-9437-415e-9735-209db829e842-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "cinder-3bde86e7-9437-415e-9735-209db829e842-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Acquiring lock "cinder-quobyte-3bde86e7-9437-415e-9735-209db829e842" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "cinder-quobyte-3bde86e7-9437-415e-9735-209db829e842" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b6a87-0d07-4905-bd13-166e92915e09]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:25 devstack sudo[93917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d
Sep 29 16:35:25 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:25 devstack sudo[93918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842
Sep 29 16:35:25 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:25 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d" returned: 0 in 0.801s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:25 devstack sudo[93931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d
Sep 29 16:35:25 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:25 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842" returned: 0 in 0.806s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:25 devstack sudo[93933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842
Sep 29 16:35:25 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:26 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e46102e9-05d0-4acc-8f9a-019642d1ae7d" returned: 0 in 1.161s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:26 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-e46102e9-05d0-4acc-8f9a-019642d1ae7d" released by "delete_volume" :: held 2.088s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3bde86e7-9437-415e-9735-209db829e842" returned: 0 in 1.010s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "cinder-quobyte-3bde86e7-9437-415e-9735-209db829e842" released by "delete_volume" :: held 1.941s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Created reservations ['5debb247-45c0-4d93-811b-c6953e3b9edb', '86c085ac-4f95-4c35-b5f2-2c2d629def38', 'b0589327-2391-45f8-81db-b7d7f7ad3903', '291986c5-4e9a-42c5-9ab0-aeef68adf8e6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Created reservations ['63f68d64-0812-427b-af53-40b3301c3fa5', 'c9af3692-3c62-411d-97d2-3f0b14aaf3cf', '374ef4bb-1fa3-4f24-abb3-727af58b3e8d', '28fca586-cd72-4394-8d9d-34c9a3aaec5a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:27 devstack sudo[93938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:27 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:27 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:27 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:28 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.688s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Deleted volume successfully.
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-339fe2e9-6342-4c6b-a19b-97ad9f41da0d tempest-VolumesTestJSON-186700603 None] Lock "cinder-e46102e9-05d0-4acc-8f9a-019642d1ae7d-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:28 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 1.000s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Deleted volume successfully.
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "cinder-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-02890d32-b5eb-40bc-92d0-eb7500efa958 tempest-AttachVolumeShelveTestJSON-1933094138 None] Lock "cinder-3bde86e7-9437-415e-9735-209db829e842-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-quobyte-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" acquired by "delete_volume" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242a1db-89ae-4573-a86b-27a0063a30fa]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:35:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:28 devstack sudo[93945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8
Sep 29 16:35:28 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:29 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" returned: 0 in 0.698s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:29 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8
Sep 29 16:35:29 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:30 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" returned: 0 in 0.599s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8" released by "delete_volume" :: held 1.426s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Created reservations ['4376da54-08bb-4941-b4f9-397ecf877001', '3d8cae14-cf7c-46ac-a011-77a0537eab4e', '53a7c9b5-9f80-4294-8e2c-9c8924a5a539', '07af6087-2d21-44a1-9aea-fff2dbf645d1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:30 devstack sudo[93953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:30 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:30 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.647s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:30 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Deleted volume successfully.
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-088cb331-eecc-4eee-af35-245b619fc71c tempest-VolumesTestJSON-186700603 None] Lock "cinder-97cc3574-0a6c-4ca6-ad6e-3898b59a51b8-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-b3f6ebdd-67c0-4542-b1f6-ad988aa52973-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "cinder-b3f6ebdd-67c0-4542-b1f6-ad988aa52973-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Acquiring lock "cinder-quobyte-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" acquired by "delete_volume" :: waited 0.078s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4481271-5fd7-4bcc-898f-9d389f1e3200]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:35:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:31 devstack sudo[93957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973
Sep 29 16:35:31 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:32 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" returned: 0 in 0.693s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:32 devstack sudo[93963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973
Sep 29 16:35:32 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:32 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" returned: 0 in 0.570s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "cinder-quobyte-b3f6ebdd-67c0-4542-b1f6-ad988aa52973" released by "delete_volume" :: held 1.407s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:32 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Created reservations ['9f34a2cf-d107-4173-87e4-8cbe112af874', 'fea88d20-ba1d-45e4-b3a0-5315fca40be9', '7d7ac627-83eb-43fd-9fa1-6be3db29e3e7', '04f985e4-840a-47af-a752-7900b72a537c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:33 devstack sudo[93966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:33 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:33 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.412s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Deleted volume successfully.
Sep 29 16:35:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b64720ac-bc26-4306-83a3-f1182ffdb4b5 tempest-VolumesTestJSON-186700603 None] Lock "cinder-b3f6ebdd-67c0-4542-b1f6-ad988aa52973-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Flow 'volume_create_manager' (77e682ea-8ac2-471d-ac66-1c24308fd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdd067b-5daf-48a1-a00d-8c33c85b4dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdd067b-5daf-48a1-a00d-8c33c85b4dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1853438666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f033f-6802-40aa-981e-787be9ffe984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f74b02afc4606a6903c72cc96a06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:41Z,use_quota=True,user_id='04e5ecdb083048ab9fbaccec9e4191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3634dd97-78fc-451b-b3da-6cc0c79df349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3634dd97-78fc-451b-b3da-6cc0c79df349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f93859-fa07-4831-929d-bb8f20126f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f93859-fa07-4831-929d-bb8f20126f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9f033f-6802-40aa-981e-787be9ffe984', 'volume_name': 'volume-df9f033f-6802-40aa-981e-787be9ffe984', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192763d4-13e5-4014-b87e-050ac7b30fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192763d4-13e5-4014-b87e-050ac7b30fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134c551d-ea0e-4203-9aa0-dcf4b8764b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:40 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume df9f033f-6802-40aa-981e-787be9ffe984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9f033f-6802-40aa-981e-787be9ffe984', 'volume_size': 1}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1853438666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9f033f-6802-40aa-981e-787be9ffe984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f74b02afc4606a6903c72cc96a06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:41Z,use_quota=True,user_id='04e5ecdb083048ab9fbaccec9e4191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Creating volume df9f033f-6802-40aa-981e-787be9ffe984 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:40 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:40 devstack sudo[94010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 1073741824
Sep 29 16:35:40 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Flow 'volume_create_manager' (76d93e38-54d8-4d95-884b-af99c820ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71a55b3-3112-4c88-9fe9-fe5238c56be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71a55b3-3112-4c88-9fe9-fe5238c56be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-659180696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccb0b84-c911-4685-960c-2f71e10940fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f74b02afc4606a6903c72cc96a06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:42Z,use_quota=True,user_id='04e5ecdb083048ab9fbaccec9e4191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5555c826-6800-4a9c-9105-f1eccd6b3a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5555c826-6800-4a9c-9105-f1eccd6b3a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6da656f-c66d-4a1f-a91d-b0adab49a7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6da656f-c66d-4a1f-a91d-b0adab49a7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccb0b84-c911-4685-960c-2f71e10940fe', 'volume_name': 'volume-8ccb0b84-c911-4685-960c-2f71e10940fe', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f942d02-f783-46f3-af3b-7a4c8289cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f942d02-f783-46f3-af3b-7a4c8289cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01245285-85f3-414c-af53-c84b8c589426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:41 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume 8ccb0b84-c911-4685-960c-2f71e10940fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccb0b84-c911-4685-960c-2f71e10940fe', 'volume_size': 1}
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:41 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 1073741824" returned: 0 in 1.099s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:42 devstack sudo[94078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984
Sep 29 16:35:42 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:42 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984" returned: 0 in 0.508s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-659180696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccb0b84-c911-4685-960c-2f71e10940fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f74b02afc4606a6903c72cc96a06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:42Z,use_quota=True,user_id='04e5ecdb083048ab9fbaccec9e4191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Creating volume 8ccb0b84-c911-4685-960c-2f71e10940fe {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:42 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:42 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe 1073741824
Sep 29 16:35:42 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134c551d-ea0e-4203-9aa0-dcf4b8764b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9f033f-6802-40aa-981e-787be9ffe984', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fba6af-634e-4bbe-bfd8-86fbe7558571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:42 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume volume-df9f033f-6802-40aa-981e-787be9ffe984 (df9f033f-6802-40aa-981e-787be9ffe984): created successfully
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fba6af-634e-4bbe-bfd8-86fbe7558571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Flow 'volume_create_manager' (77e682ea-8ac2-471d-ac66-1c24308fd921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-18b0523c-98d8-4755-b3c7-5640af808a09 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Created volume successfully.
Sep 29 16:35:43 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe 1073741824" returned: 0 in 0.790s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:43 devstack sudo[94108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe
Sep 29 16:35:43 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:43 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe" returned: 0 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01245285-85f3-414c-af53-c84b8c589426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccb0b84-c911-4685-960c-2f71e10940fe', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02890fdb-7e57-4e61-8ca0-9ef48cc7aa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:43 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Volume volume-8ccb0b84-c911-4685-960c-2f71e10940fe (8ccb0b84-c911-4685-960c-2f71e10940fe): created successfully
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02890fdb-7e57-4e61-8ca0-9ef48cc7aa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Flow 'volume_create_manager' (76d93e38-54d8-4d95-884b-af99c820ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7f3bd0ba-94f7-4f6a-a0f2-74b021ec7f81 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Created volume successfully.
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Flow 'volume_create_manager' (58749a71-3a85-47e6-b799-b8b3113f102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eba3b0-9eda-41fc-a057-cafb562a9f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84eba3b0-9eda-41fc-a057-cafb562a9f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-152052486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e174fa1-4057-4bb3-8eef-13c2490bbdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49904b53e8264c01904453bfdcd92463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:49Z,use_quota=True,user_id='baaf85b471fc4c898fe2e156d93f0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ae2c75-3b68-4d91-8c65-2591599b6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ae2c75-3b68-4d91-8c65-2591599b6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c794a7-384d-4ae4-84f7-d8a49e356299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c794a7-384d-4ae4-84f7-d8a49e356299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e174fa1-4057-4bb3-8eef-13c2490bbdf0', 'volume_name': 'volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe44942-621f-4c26-abd1-6fd640a7df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe44942-621f-4c26-abd1-6fd640a7df95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595280e7-236a-4c71-bc5e-e6b1ef3630b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Volume 5e174fa1-4057-4bb3-8eef-13c2490bbdf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0', 'volume_size': 1}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-152052486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e174fa1-4057-4bb3-8eef-13c2490bbdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49904b53e8264c01904453bfdcd92463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:49Z,use_quota=True,user_id='baaf85b471fc4c898fe2e156d93f0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Creating volume 5e174fa1-4057-4bb3-8eef-13c2490bbdf0 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:35:49 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:35:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:49 devstack sudo[94159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 1073741824
Sep 29 16:35:49 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:50 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 1073741824" returned: 0 in 0.775s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:50 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0
Sep 29 16:35:50 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:50 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" returned: 0 in 0.390s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595280e7-236a-4c71-bc5e-e6b1ef3630b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622d59f8-d809-4dc6-aa35-0edba67e2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:35:50 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Volume volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 (5e174fa1-4057-4bb3-8eef-13c2490bbdf0): created successfully
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622d59f8-d809-4dc6-aa35-0edba67e2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:35:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Flow 'volume_create_manager' (58749a71-3a85-47e6-b799-b8b3113f102a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:35:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-54d431dd-b9c4-4b08-a1af-91f48cef0700 tempest-ServerRescueNegativeTestJSON-1631294740 None] Created volume successfully.
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:35:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:35:53 devstack sudo[94176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:35:53 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:35:54 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root
Sep 29 16:35:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.822s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:35:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:35:54 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:35:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:35:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:36:00 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=54,cinder:SELECT=25,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:36:01 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=40,cinder:UPDATE=47,cinder:INSERT=8,cinder:DELETE=6 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Flow 'volume_create_manager' (de727143-beec-41db-bad0-9f5107807b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1048b1e4-be77-4891-be8c-acef2407ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1048b1e4-be77-4891-be8c-acef2407ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1652278234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f53dd-ccaa-4864-ba99-776c1d8bd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c11b1160a9471dbe3ceb436c1cbe19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:04Z,use_quota=True,user_id='0223ee33c95f414c96c5fa709e57dd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41e4515-8e3d-43c9-8895-f48634406214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41e4515-8e3d-43c9-8895-f48634406214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8779d7c4-04da-48f9-ae85-c4ddca7728b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8779d7c4-04da-48f9-ae85-c4ddca7728b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349f53dd-ccaa-4864-ba99-776c1d8bd554', 'volume_name': 'volume-349f53dd-ccaa-4864-ba99-776c1d8bd554', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb9f54-9b32-442b-bf90-a0381439f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb9f54-9b32-442b-bf90-a0381439f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878fcc9-590a-4218-afa8-c32d8f3d6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:04 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Volume 349f53dd-ccaa-4864-ba99-776c1d8bd554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349f53dd-ccaa-4864-ba99-776c1d8bd554', 'volume_size': 1}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1652278234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f53dd-ccaa-4864-ba99-776c1d8bd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c11b1160a9471dbe3ceb436c1cbe19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:04Z,use_quota=True,user_id='0223ee33c95f414c96c5fa709e57dd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Creating volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:36:04 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:36:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:04 devstack sudo[94335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 1073741824
Sep 29 16:36:04 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:05 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 1073741824" returned: 0 in 0.996s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:05 devstack sudo[94340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554
Sep 29 16:36:05 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:06 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554" returned: 0 in 0.478s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878fcc9-590a-4218-afa8-c32d8f3d6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349f53dd-ccaa-4864-ba99-776c1d8bd554', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1ce56-f5b0-484d-9e84-208fd2098414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Volume volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 (349f53dd-ccaa-4864-ba99-776c1d8bd554): created successfully
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1ce56-f5b0-484d-9e84-208fd2098414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Flow 'volume_create_manager' (de727143-beec-41db-bad0-9f5107807b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-edacedf8-01a6-4e17-954d-3680a1667d0e tempest-SnapshotsActionsTest-1229880594 None] Created volume successfully.
Sep 29 16:36:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Creating offline snapshot e02b6633-57d9-472b-977d-5c80b3a0ffad of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa675f-fb12-4df1-bc89-cffbbd9a32b3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:07 devstack sudo[94344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554
Sep 29 16:36:07 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:08 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554" returned: 0 in 1.151s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:08 devstack sudo[94355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad 1G
Sep 29 16:36:08 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:09 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad 1G" returned: 0 in 1.184s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:10 devstack sudo[94361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:10 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:10 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.680s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:10 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad is being set with open permissions: ugo+rw
Sep 29 16:36:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:10 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:10 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:11 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.434s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:11 devstack sudo[94387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info
Sep 29 16:36:11 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:11 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:11 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info is being set with open permissions: ugo+rw
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:11 devstack sudo[94397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info
Sep 29 16:36:11 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:11 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.info" returned: 0 in 0.455s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.471s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5d466065-6e25-4b95-87c1-97601e1fb6c1 tempest-SnapshotsActionsTest-1229880594 None] Create snapshot completed successfully
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Creating offline snapshot 58ee33b3-8b53-410d-947d-23eff0d09b8e of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff0eb4a-d5a2-4d62-b661-7392420035c2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:14 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:14 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:14 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.629s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:14 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e 1G
Sep 29 16:36:14 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:15 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e 1G" returned: 0 in 1.067s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:16 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e
Sep 29 16:36:16 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Acquiring lock "cinder-5e174fa1-4057-4bb3-8eef-13c2490bbdf0-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "cinder-5e174fa1-4057-4bb3-8eef-13c2490bbdf0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Acquiring lock "cinder-quobyte-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "cinder-quobyte-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1affb4a-2299-468f-96d3-cf71859157a4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:17 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0
Sep 29 16:36:17 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:17 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e" returned: 0 in 1.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:17 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e is being set with open permissions: ugo+rw
Sep 29 16:36:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:17 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e
Sep 29 16:36:17 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:18 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e" returned: 0 in 1.058s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:18 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.247s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" returned: 0 in 1.734s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:18 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0
Sep 29 16:36:18 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-85ed4e95-2e7a-4ee8-ada2-c03ac29ca78e tempest-SnapshotsActionsTest-1229880594 None] Create snapshot completed successfully
Sep 29 16:36:18 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" returned: 0 in 0.461s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "cinder-quobyte-5e174fa1-4057-4bb3-8eef-13c2490bbdf0" released by "delete_volume" :: held 2.345s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Created reservations ['9102969c-48d8-4f16-a5dc-9aa2e678704e', 'd094d531-5259-4304-8925-912c4e8f300d', '13ffd1cb-f1f8-468e-866a-2404f4a49170', 'e5a33b75-1a0a-4d1c-a4b6-a51623376c36'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:19 devstack sudo[94575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:36:19 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:19 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:36:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Deleted volume successfully.
Sep 29 16:36:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-37c9a327-c307-480f-9c68-4d0b9f87acf6 tempest-ServerRescueNegativeTestJSON-1631294740 None] Lock "cinder-5e174fa1-4057-4bb3-8eef-13c2490bbdf0-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-58ee33b3-8b53-410d-947d-23eff0d09b8e-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-58ee33b3-8b53-410d-947d-23eff0d09b8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-58ee33b3-8b53-410d-947d-23eff0d09b8e" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-58ee33b3-8b53-410d-947d-23eff0d09b8e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Deleting offline snapshot 58ee33b3-8b53-410d-947d-23eff0d09b8e of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] snapshot_file for this snap is: volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f92b0a-46f6-40d2-8343-f556324106ed]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:20 devstack sudo[94606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e
Sep 29 16:36:20 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:21 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e" returned: 0 in 1.154s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c416da-3610-45d9-b9a3-cec314559e18]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:21 devstack sudo[94628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:21 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:22 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 1.255s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:22 devstack sudo[94657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e
Sep 29 16:36:22 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:23 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e" returned: 0 in 0.918s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:23 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e
Sep 29 16:36:23 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:24 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.58ee33b3-8b53-410d-947d-23eff0d09b8e" returned: 0 in 0.473s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-58ee33b3-8b53-410d-947d-23eff0d09b8e" released by "_delete_snapshot" :: held 4.045s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_snapshot" :: held 4.101s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:24 devstack cinder-volume[86843]: WARNING cinder.quota [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:36:24 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Created reservations ['14b7000b-dd4f-4785-a845-c682707fed96', 'e7aaea5c-88a1-4c94-8566-b688dfe6a28a', 'ff11367c-5fd8-4e33-97de-a9b5b0aa2844', 'd16a11e2-1929-4b62-a8f0-59bd5d1e6318'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Delete snapshot completed successfully.
Sep 29 16:36:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-40032614-9194-46d1-b30f-604bb741508f tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-58ee33b3-8b53-410d-947d-23eff0d09b8e-delete_snapshot" released by "delete_snapshot" :: held 4.520s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Creating offline snapshot 795639ad-adbf-46f4-9aa9-63ac541f7a36 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:25 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eec41e-00f7-4686-a69d-cb0bd8a58290]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:25 devstack sudo[94668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:25 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:26 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.886s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:26 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 1G
Sep 29 16:36:26 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:27 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 1G" returned: 0 in 1.045s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:27 devstack sudo[94707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36
Sep 29 16:36:27 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:28 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36" returned: 0 in 0.637s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:28 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 is being set with open permissions: ugo+rw
Sep 29 16:36:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:28 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36
Sep 29 16:36:28 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:28 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36" returned: 0 in 0.600s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-014ba675-e2e1-40d5-ad04-9555134391ec tempest-SnapshotsActionsTest-1229880594 None] Create snapshot completed successfully
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-61e98a0a-a5f1-41ab-8abd-bc47bd6868d2 req-0752a83c-dd4e-4d83-afef-d3ecf44175c0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-61e98a0a-a5f1-41ab-8abd-bc47bd6868d2 req-0752a83c-dd4e-4d83-afef-d3ecf44175c0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-61e98a0a-a5f1-41ab-8abd-bc47bd6868d2 req-0752a83c-dd4e-4d83-afef-d3ecf44175c0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-61e98a0a-a5f1-41ab-8abd-bc47bd6868d2 req-0752a83c-dd4e-4d83-afef-d3ecf44175c0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-df9f033f-6802-40aa-981e-787be9ffe984', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84b328b5-7999-42c7-ab92-ff2d13a578e5', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-795639ad-adbf-46f4-9aa9-63ac541f7a36-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-795639ad-adbf-46f4-9aa9-63ac541f7a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-795639ad-adbf-46f4-9aa9-63ac541f7a36" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-795639ad-adbf-46f4-9aa9-63ac541f7a36" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Deleting offline snapshot 795639ad-adbf-46f4-9aa9-63ac541f7a36 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] snapshot_file for this snap is: volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:36:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-61e98a0a-a5f1-41ab-8abd-bc47bd6868d2 req-0752a83c-dd4e-4d83-afef-d3ecf44175c0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] attachment_update completed successfully.
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7945d3-da3a-4fa1-ae34-2439d45bab16]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:30 devstack sudo[94730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36
Sep 29 16:36:30 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:30 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36" returned: 0 in 0.618s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000cf34-8d86-40fc-9b36-7dbd0f5c073f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:30 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:30 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:31 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.563s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:31 devstack sudo[95160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36
Sep 29 16:36:31 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:31 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36" returned: 0 in 0.477s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:31 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36
Sep 29 16:36:31 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:32 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.795639ad-adbf-46f4-9aa9-63ac541f7a36" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-795639ad-adbf-46f4-9aa9-63ac541f7a36" released by "_delete_snapshot" :: held 2.207s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_snapshot" :: held 2.242s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:32 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Created reservations ['96f62b64-8b11-43c6-a897-935f3db81d45', '1a4c5f92-0109-4b1f-a858-52c69c288a3b', 'bce9a2d6-4d7d-4d8b-beb8-43e0e26774d4', 'e807c246-5731-495f-92e4-e3d1a2354f1c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Delete snapshot completed successfully.
Sep 29 16:36:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a83386c6-a20c-4100-b359-cab3c13bc099 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-795639ad-adbf-46f4-9aa9-63ac541f7a36-delete_snapshot" released by "delete_snapshot" :: held 2.441s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Creating offline snapshot 76180f98-464a-41fb-aeb8-7998605d8da3 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728f9c4-295b-4a34-a80c-364a3a215ca8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:33 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:33 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:34 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.508s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:34 devstack sudo[95196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 1G
Sep 29 16:36:34 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:34 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 1G" returned: 0 in 0.522s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:34 devstack sudo[95202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3
Sep 29 16:36:34 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:35 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3" returned: 0 in 0.414s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:35 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 is being set with open permissions: ugo+rw
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:35 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3
Sep 29 16:36:35 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:35 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8a3f8d0a-a8c5-4536-833a-b63b9fc0d8df tempest-SnapshotsActionsTest-1229880594 None] Create snapshot completed successfully
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-02a7880f-f12a-4b58-bb03-02884cf6b882 req-0c540189-d697-46d9-91ea-55bb2cca8826 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-02a7880f-f12a-4b58-bb03-02884cf6b882 req-0c540189-d697-46d9-91ea-55bb2cca8826 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-02a7880f-f12a-4b58-bb03-02884cf6b882 req-0c540189-d697-46d9-91ea-55bb2cca8826 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-02a7880f-f12a-4b58-bb03-02884cf6b882 req-0c540189-d697-46d9-91ea-55bb2cca8826 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-8ccb0b84-c911-4685-960c-2f71e10940fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afba8fad-5a81-40b5-a867-5bf4f2da321f', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:36:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-02a7880f-f12a-4b58-bb03-02884cf6b882 req-0c540189-d697-46d9-91ea-55bb2cca8826 tempest-TestServerVolumeAttachmentScenario-1424235002 None] attachment_update completed successfully.
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-76180f98-464a-41fb-aeb8-7998605d8da3-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-76180f98-464a-41fb-aeb8-7998605d8da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-76180f98-464a-41fb-aeb8-7998605d8da3" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-76180f98-464a-41fb-aeb8-7998605d8da3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Deleting offline snapshot 76180f98-464a-41fb-aeb8-7998605d8da3 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] snapshot_file for this snap is: volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af1a56-a284-4067-a896-355ab9447f6b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:36 devstack sudo[95225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3
Sep 29 16:36:36 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:36 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3" returned: 0 in 0.474s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844a2ac-c6ea-4055-9a39-d5530b882921]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:36 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:36 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:36 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.408s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:37 devstack sudo[95240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3
Sep 29 16:36:37 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:37 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3" returned: 0 in 0.421s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:37 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3
Sep 29 16:36:37 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:37 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.76180f98-464a-41fb-aeb8-7998605d8da3" returned: 0 in 0.268s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-76180f98-464a-41fb-aeb8-7998605d8da3" released by "_delete_snapshot" :: held 1.743s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_snapshot" :: held 1.773s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Created reservations ['c69688b7-5219-4ebc-9620-18438083d159', '6495e280-4ee9-41fe-81b8-afc48f64229c', 'ea65de62-80a8-4b86-939e-73d3256fe5a1', '2c243efd-983d-473e-aa64-787463b53b3f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Delete snapshot completed successfully.
Sep 29 16:36:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de70d572-d450-4030-88e3-33872adef260 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-76180f98-464a-41fb-aeb8-7998605d8da3-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Creating offline snapshot ac736a43-9822-4046-90f1-c55a8d057375 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312b89d-a112-4a54-a277-c90d61693d33]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:38 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:38 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-e0bd729d-951a-4b67-9e83-d5196938f56d req-7857afc7-0438-42a3-98fc-40285ef5e255 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Terminate volume connection completed successfully.
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-e0bd729d-951a-4b67-9e83-d5196938f56d req-7857afc7-0438-42a3-98fc-40285ef5e255 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Deleting attachment afba8fad-5a81-40b5-a867-5bf4f2da321f. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:36:38 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:38 devstack sudo[95258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 1G
Sep 29 16:36:38 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:39 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 1G" returned: 0 in 0.587s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:39 devstack sudo[95299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375
Sep 29 16:36:39 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:39 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375" returned: 0 in 0.349s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:39 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 is being set with open permissions: ugo+rw
Sep 29 16:36:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:39 devstack sudo[95304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375
Sep 29 16:36:39 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:40 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6e6b27f0-5a22-4da2-b976-7c1967cb69ae tempest-SnapshotsActionsTest-1229880594 None] Create snapshot completed successfully
Sep 29 16:36:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-958f6cc7-4932-4c1b-bf6f-0a7cf624bfbf req-a7bbffd6-7168-40f2-a400-076b9fe7b4b0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Terminate volume connection completed successfully.
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-958f6cc7-4932-4c1b-bf6f-0a7cf624bfbf req-a7bbffd6-7168-40f2-a400-076b9fe7b4b0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Deleting attachment 84b328b5-7999-42c7-ab92-ff2d13a578e5. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-ac736a43-9822-4046-90f1-c55a8d057375-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-ac736a43-9822-4046-90f1-c55a8d057375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Acquiring lock "cinder-quobyte-ac736a43-9822-4046-90f1-c55a8d057375" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-13e96121-cbc7-4ebd-8a3d-85a1e01ab1fa tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-2019333763: creating
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-ac736a43-9822-4046-90f1-c55a8d057375" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Deleting offline snapshot ac736a43-9822-4046-90f1-c55a8d057375 of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] snapshot_file for this snap is: volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576dba5-000a-4f85-98eb-076e19ddf8a2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-13e96121-cbc7-4ebd-8a3d-85a1e01ab1fa tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-2019333763: created successfully
Sep 29 16:36:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-13e96121-cbc7-4ebd-8a3d-85a1e01ab1fa tempest-GroupSnapshotsTest-839267946 None] Create group completed successfully.
Sep 29 16:36:40 devstack sudo[95337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375
Sep 29 16:36:40 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:41 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375" returned: 0 in 0.434s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c0e3e-d74b-4581-a05d-c63fbe7f6446]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:41 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:41 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:41 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:41 devstack sudo[95363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375
Sep 29 16:36:41 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:42 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375" returned: 0 in 0.662s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:42 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375
Sep 29 16:36:42 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (1568dac0-6717-4e64-af56-ff437232fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015edd9-a277-47e9-aec1-b0368330d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015edd9-a277-47e9-aec1-b0368330d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537539896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=698f5d9a-e82c-4e4e-958c-478df0644bc3,host='devstack@QuobyteHD#QuobyteHD',id=a5694a0b-8c66-4013-ae07-3b4598fccd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:43Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47816d7f-8ce2-4302-9b4e-17a0eae81a49),volume_type_id=47816d7f-8ce2-4302-9b4e-17a0eae81a49)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24568f3b-6fe0-46ce-af87-b414b44baf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24568f3b-6fe0-46ce-af87-b414b44baf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9476b4fd-3197-49a6-9317-53952c726e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9476b4fd-3197-49a6-9317-53952c726e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5694a0b-8c66-4013-ae07-3b4598fccd0f', 'volume_name': 'volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6ec805-2649-45a3-99b1-bb3a0635cb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6ec805-2649-45a3-99b1-bb3a0635cb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df978144-087b-4138-9aa0-4de970f49725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:43 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Volume a5694a0b-8c66-4013-ae07-3b4598fccd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f', 'volume_size': 1}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=698f5d9a-e82c-4e4e-958c-478df0644bc3,created_at=2026-09-29T14:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537539896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=698f5d9a-e82c-4e4e-958c-478df0644bc3,host='devstack@QuobyteHD#QuobyteHD',id=a5694a0b-8c66-4013-ae07-3b4598fccd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:43Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47816d7f-8ce2-4302-9b4e-17a0eae81a49),volume_type_id=47816d7f-8ce2-4302-9b4e-17a0eae81a49)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Creating volume a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:36:43 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:43 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f 1073741824
Sep 29 16:36:43 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:43 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.ac736a43-9822-4046-90f1-c55a8d057375" returned: 0 in 0.634s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-ac736a43-9822-4046-90f1-c55a8d057375" released by "_delete_snapshot" :: held 2.419s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_snapshot" :: held 2.458s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Created reservations ['5d019632-7824-45a3-a94a-bb575fb94142', '8f3e931f-2940-4d14-a548-d64f3e784eaf', 'd04603f0-35c6-496f-954e-821dfc276881', '20207d35-6e05-4dcb-9fd5-0d98558ef00c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Delete snapshot completed successfully.
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a377c5cd-8980-4dd6-8d23-3c017549d685 tempest-SnapshotsActionsTest-769345469 None] Lock "cinder-ac736a43-9822-4046-90f1-c55a8d057375-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:43 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f 1073741824" returned: 0 in 0.680s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:43 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:36:43 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:44 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df978144-087b-4138-9aa0-4de970f49725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1920d8c-b33c-404c-ae01-24d55a4acbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:44 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Volume volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f (a5694a0b-8c66-4013-ae07-3b4598fccd0f): created successfully
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1920d8c-b33c-404c-ae01-24d55a4acbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (1568dac0-6717-4e64-af56-ff437232fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9e065d9a-1908-4a45-a792-98594e628868 tempest-GroupSnapshotsTest-839267946 None] Created volume successfully.
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "cinder-e02b6633-57d9-472b-977d-5c80b3a0ffad-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-e02b6633-57d9-472b-977d-5c80b3a0ffad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "cinder-quobyte-e02b6633-57d9-472b-977d-5c80b3a0ffad" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-e02b6633-57d9-472b-977d-5c80b3a0ffad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Deleting offline snapshot e02b6633-57d9-472b-977d-5c80b3a0ffad of volume 349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] snapshot_file for this snap is: volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe4ce9-c2b3-4f60-8bd4-0d8438a47cd0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:44 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:44 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:45 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.409s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-349f53dd-ccaa-4864-ba99-776c1d8bd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848f58b-ae67-45b7-952d-74b85d8920ec]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:45 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554
Sep 29 16:36:45 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:45 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:45 devstack sudo[95404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:45 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] GroupSnapshot fd075e10-1624-4a52-be82-d56561ab7162: creating.
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Group snapshot fd075e10-1624-4a52-be82-d56561ab7162: creating. {{(pid=86843) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Creating offline snapshot db47618b-55cd-4b2d-bd23-201d52ea6388 of volume a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df195f-f4bf-4337-904a-799673857d09]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:45 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:46 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad
Sep 29 16:36:46 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:46 devstack sudo[95409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:36:46 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:46 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554.e02b6633-57d9-472b-977d-5c80b3a0ffad" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-e02b6633-57d9-472b-977d-5c80b3a0ffad" released by "_delete_snapshot" :: held 1.706s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_snapshot" :: held 1.732s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:46 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.479s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:46 devstack sudo[95419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 1G
Sep 29 16:36:46 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Created reservations ['e548041e-93ba-4f35-94c9-d057d6a5e9ee', '93cb14a3-8946-4b26-9396-8a257ab1cf02', 'e176cf95-cf3f-45b2-be0e-3f643360bd72', 'cd191dbb-539f-40a9-a931-3f3e52410946'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Delete snapshot completed successfully.
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-449263a0-334d-4a7c-8571-2685cef86cfc tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-e02b6633-57d9-472b-977d-5c80b3a0ffad-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "cinder-8ccb0b84-c911-4685-960c-2f71e10940fe-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-8ccb0b84-c911-4685-960c-2f71e10940fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "cinder-quobyte-8ccb0b84-c911-4685-960c-2f71e10940fe" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-quobyte-8ccb0b84-c911-4685-960c-2f71e10940fe" acquired by "delete_volume" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94ecb6-7f75-491b-8bbd-54f758f692d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "cinder-349f53dd-ccaa-4864-ba99-776c1d8bd554-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-349f53dd-ccaa-4864-ba99-776c1d8bd554-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:47 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (e680f836-7c15-432d-9831-4702766f4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:47 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe
Sep 29 16:36:47 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc329979-bea0-42b6-8a56-b7721aab0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 1G" returned: 0 in 0.718s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc329979-bea0-42b6-8a56-b7721aab0266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1088102712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2b14ce-3bd5-4222-a64d-d6566db6736c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:47Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:47 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:36:47 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cc3990-bd65-4b53-b08e-021dc0fb145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cc3990-bd65-4b53-b08e-021dc0fb145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1afd5-abcf-41d4-9ddd-2175b772fc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1afd5-abcf-41d4-9ddd-2175b772fc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2b14ce-3bd5-4222-a64d-d6566db6736c', 'volume_name': 'volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883061df-e517-488a-b601-367566e90f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883061df-e517-488a-b601-367566e90f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2400dbe8-08ab-43ee-8d59-2bef173cad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Volume 2d2b14ce-3bd5-4222-a64d-d6566db6736c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c', 'volume_size': 1}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe44935-142f-4390-84a3-62122628446b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554
Sep 29 16:36:47 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe" returned: 0 in 0.520s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe
Sep 29 16:36:47 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:36:47 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554" returned: 0 in 0.408s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554
Sep 29 16:36:47 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ccb0b84-c911-4685-960c-2f71e10940fe" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-quobyte-8ccb0b84-c911-4685-960c-2f71e10940fe" released by "delete_volume" :: held 0.880s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info
Sep 29 16:36:47 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Created reservations ['23664688-34ca-4626-b039-f9e3758e14e2', '1b4e89c2-be5d-4bee-9dd1-e376c71125de', 'd01bffae-c168-4533-b5ca-f5e189b5c398', '7f26ecb5-326d-4933-a795-c265a8b81eb0'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:47 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:36:47 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:47 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-349f53dd-ccaa-4864-ba99-776c1d8bd554" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-quobyte-349f53dd-ccaa-4864-ba99-776c1d8bd554" released by "delete_volume" :: held 0.803s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "cinder-df9f033f-6802-40aa-981e-787be9ffe984-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Created reservations ['cfd1a70d-463a-4431-9ea3-0661b3ca1147', 'bd21e017-ab84-4fd5-9222-da337f63d4b3', '4522a644-b53f-47e8-8f96-6caf30178eab', 'a7e82ddf-59b0-48cb-9d3c-e81c43f1567b'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:48 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-df9f033f-6802-40aa-981e-787be9ffe984-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info" returned: 0 in 0.380s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:48 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info
Sep 29 16:36:48 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "cinder-quobyte-df9f033f-6802-40aa-981e-787be9ffe984" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-quobyte-df9f033f-6802-40aa-981e-787be9ffe984" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:48 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.371s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:36:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Deleted volume successfully.
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0c720-a9e9-490f-a7ce-e68cb5e8094e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f1e484d-77af-46d7-8886-1dcaa44f99bb tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-8ccb0b84-c911-4685-960c-2f71e10940fe-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:48 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:36:48 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:48 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984
Sep 29 16:36:48 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:48 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.info" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1088102712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2b14ce-3bd5-4222-a64d-d6566db6736c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:47Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Creating volume 2d2b14ce-3bd5-4222-a64d-d6566db6736c {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:36:48 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:48 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c 1073741824
Sep 29 16:36:48 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2ba411b0-616f-445b-b14e-696dc5c6adcf tempest-GroupSnapshotsTest-839267946 None] group_snapshot fd075e10-1624-4a52-be82-d56561ab7162: created successfully
Sep 29 16:36:48 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:36:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Deleted volume successfully.
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-68930afe-1921-4670-a556-25cf0a9c4a1a tempest-SnapshotsActionsTest-1229880594 None] Lock "cinder-349f53dd-ccaa-4864-ba99-776c1d8bd554-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:48 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984" returned: 0 in 0.446s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:48 devstack sudo[95472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984
Sep 29 16:36:48 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:48 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c 1073741824" returned: 0 in 0.466s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-df9f033f-6802-40aa-981e-787be9ffe984" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-quobyte-df9f033f-6802-40aa-981e-787be9ffe984" released by "delete_volume" :: held 0.761s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:49 devstack sudo[95476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c
Sep 29 16:36:49 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Created reservations ['de7d960d-390d-4aca-935f-f82a1dd931f1', '285a5509-f0da-496e-b231-556e467c9bb8', '1dfe1410-5c75-4d7f-8ffb-75b16aeb7228', '4c656cbb-0374-4c3d-b9c6-f0e75590a173'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:49 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:36:49 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:49 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2400dbe8-08ab-43ee-8d59-2bef173cad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c05882-6bfc-477c-b7ee-c3b93ba65235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:36:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Volume volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c (2d2b14ce-3bd5-4222-a64d-d6566db6736c): created successfully
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c05882-6bfc-477c-b7ee-c3b93ba65235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (e680f836-7c15-432d-9831-4702766f4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:36:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d60d2a53-55d6-42d7-b076-22ba16c7f9f5 tempest-AttachVolumeNegativeTest-1073949744 None] Created volume successfully.
Sep 29 16:36:49 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:36:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Deleted volume successfully.
Sep 29 16:36:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-81f3e39b-9649-4240-8273-af3b84ff92d0 tempest-TestServerVolumeAttachmentScenario-1424235002 None] Lock "cinder-df9f033f-6802-40aa-981e-787be9ffe984-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Creating volume d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 from snapshot db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] snapshot: db47618b-55cd-4b2d-bd23-201d52ea6388, volume: d13e7e27-dfb6-4226-a8a5-13bc2f9b3323,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[215ccde2-ab9b-4d6a-ab61-46b8b7f96206]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:50 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:36:50 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:50 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.508s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[45031f5e-733e-4923-8495-75d2b1a82b0c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:36:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:50 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:36:50 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:51 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.606s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:51 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323
Sep 29 16:36:51 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-35e77d17-4e39-4608-8e48-cc619d197800 req-83b95f35-28e6-42e9-ad8d-e71419557c90 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:36:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:36:53 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:36:53 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:36:54 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Sep 29 16:36:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.890s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:36:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:36:54 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:36:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:36:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:37:00 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" returned: 0 in 8.866s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:37:00 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Converted 1024.00 MB image at 115.48 MB/s
Sep 29 16:37:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:00 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323
Sep 29 16:37:00 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:00 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" released by "_copy_volume_from_snapshot" :: held 10.393s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" released by "_create_volume_from_snapshot" :: held 10.502s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.528s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-35e77d17-4e39-4608-8e48-cc619d197800 req-83b95f35-28e6-42e9-ad8d-e71419557c90 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.104s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-35e77d17-4e39-4608-8e48-cc619d197800 req-83b95f35-28e6-42e9-ad8d-e71419557c90 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-35e77d17-4e39-4608-8e48-cc619d197800 req-83b95f35-28e6-42e9-ad8d-e71419557c90 tempest-AttachVolumeNegativeTest-1073949744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93bda3ae-0e23-4d3b-a443-57a84dff191e', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:37:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bfee9e52-32e7-4aec-9d90-ba303c2f9c11 tempest-GroupSnapshotsTest-839267946 None] Create group from source-snapshot-fd075e10-1624-4a52-be82-d56561ab7162 completed successfully.
Sep 29 16:37:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-35e77d17-4e39-4608-8e48-cc619d197800 req-83b95f35-28e6-42e9-ad8d-e71419557c90 tempest-AttachVolumeNegativeTest-1073949744 None] attachment_update completed successfully.
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=96,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=84,cinder:SELECT=100,cinder:DELETE=6,cinder:INSERT=19 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" acquired by "delete_volume" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a0bd1-db32-472f-8161-2cbf441f62fe]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:02 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323
Sep 29 16:37:02 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:02 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:02 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323
Sep 29 16:37:02 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:03 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-d13e7e27-dfb6-4226-a8a5-13bc2f9b3323" released by "delete_volume" :: held 0.858s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Created reservations ['4c1f114e-a153-42f8-a021-80f6d520c685'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:03 devstack cinder-volume[86843]: WARNING cinder.quota [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-867136458 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-867136458, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:03 devstack cinder-volume[86843]: WARNING cinder.quota [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-867136458 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-867136458, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Created reservations ['e30878f7-8107-4f24-aac7-853ab30d6d89', '75e4d18d-b0df-43ba-bf6b-3cddb5f53aa8', '42e6d2b2-0be5-489c-a371-c8d79de970a0', 'd29240a6-647a-4b00-9801-833eb6d02f32'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:03 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:03 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] group_snapshot fd075e10-1624-4a52-be82-d56561ab7162: deleting
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] group_snapshot fd075e10-1624-4a52-be82-d56561ab7162: deleting {{(pid=86843) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Deleting offline snapshot db47618b-55cd-4b2d-bd23-201d52ea6388 of volume a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:37:03 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] snapshot_file for this snap is: volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-54d4680e-2321-4179-bef2-63dc126db914 tempest-GroupSnapshotsTest-839267946 None] Delete group completed successfully.
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279a129-0177-4bb9-8502-2ab291ac4894]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:04 devstack sudo[95979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:37:04 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:04 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.488s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[208408a4-7ed7-4b74-824a-2a9c04a8529f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:04 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:37:04 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:05 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.689s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:05 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:37:05 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:05 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.517s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:05 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388
Sep 29 16:37:05 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:06 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f.db47618b-55cd-4b2d-bd23-201d52ea6388" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-db47618b-55cd-4b2d-bd23-201d52ea6388" released by "_delete_snapshot" :: held 2.194s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" released by "delete_snapshot" :: held 2.237s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:06 devstack cinder-volume[86843]: WARNING cinder.quota [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-867136458 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-867136458, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:06 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] Created reservations ['cbe3d75f-7e0f-45d5-bdf1-1a7594c533cf', 'ea571c78-acff-4325-aa11-9f059491a26f', '43740c2d-e768-4597-beab-09523922693d', '02bdc069-d1a6-4046-99b2-013c4c0c3039'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-66cdaccc-a8d0-4092-97c7-9c491e4fdeef tempest-GroupSnapshotsTest-839267946 None] group_snapshot fd075e10-1624-4a52-be82-d56561ab7162: deleted successfully
Sep 29 16:37:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b2d8d7-26b7-49af-bc4f-6a54ef055f11]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:07 devstack sudo[96003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:37:07 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:08 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.569s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:08 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f
Sep 29 16:37:08 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:08 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5694a0b-8c66-4013-ae07-3b4598fccd0f" returned: 0 in 0.316s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-a5694a0b-8c66-4013-ae07-3b4598fccd0f" released by "delete_volume" :: held 1.000s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Created reservations ['d1ece2fe-92e9-46c7-bb77-17e7e53959ca'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:08 devstack cinder-volume[86843]: WARNING cinder.db.api [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-867136458']
Sep 29 16:37:08 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Created reservations ['ccad05e2-2f42-4b56-8b36-ba563555b9b5', 'f9933b5b-962f-4765-be68-fe8d513ba548', 'd48f2ac9-a4fc-423f-aef5-a18ac024e34f', 'f8c3e049-4010-4d06-807b-192b84a46918'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:09 devstack sudo[96011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:09 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:09 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.415s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:09 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7417f53c-d59f-4973-ba79-84f2d855303f tempest-GroupSnapshotsTest-839267946 None] Delete group completed successfully.
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (95506e07-494e-405d-b45c-c3132fb4bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df1b983-0f58-47f9-9186-28765cdf6ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Flow 'volume_create_manager' (ca98f213-9db2-409d-9510-1cf780055ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3782c683-2475-4f42-a701-7b832c55199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df1b983-0f58-47f9-9186-28765cdf6ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845581518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc05733-fc65-474b-96d8-c06edafdeb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:10Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff2fa99-a4df-4724-87cd-d1c58518ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff2fa99-a4df-4724-87cd-d1c58518ed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66217961-9d73-4d90-a14e-23f5279f8dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66217961-9d73-4d90-a14e-23f5279f8dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc05733-fc65-474b-96d8-c06edafdeb51', 'volume_name': 'volume-9cc05733-fc65-474b-96d8-c06edafdeb51', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77493f4-95b8-4eb2-bfe2-468606aaa771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77493f4-95b8-4eb2-bfe2-468606aaa771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b41ec4-5fca-4be7-ac85-bae5b6a59f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume 9cc05733-fc65-474b-96d8-c06edafdeb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc05733-fc65-474b-96d8-c06edafdeb51', 'volume_size': 1}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845581518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc05733-fc65-474b-96d8-c06edafdeb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:10Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume 9cc05733-fc65-474b-96d8-c06edafdeb51 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:10 devstack sudo[96032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 1073741824
Sep 29 16:37:10 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3782c683-2475-4f42-a701-7b832c55199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1949687041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1466405f-2542-4b1f-b702-84252bfbf0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1fd7bf7b79455f8289b631d6e5fa4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:10Z,use_quota=True,user_id='d6321dfedcb645adb02bbe6f519a7aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8180a493-fe33-4b4d-a0e7-52159103d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8180a493-fe33-4b4d-a0e7-52159103d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb83240-af2c-4032-91f2-2e50694ce847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb83240-af2c-4032-91f2-2e50694ce847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1466405f-2542-4b1f-b702-84252bfbf0d1', 'volume_name': 'volume-1466405f-2542-4b1f-b702-84252bfbf0d1', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff6e81-ef53-4f8c-b130-3c8f829772e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff6e81-ef53-4f8c-b130-3c8f829772e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e4e929-881d-49d2-8d06-bc7ea7874ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Volume 1466405f-2542-4b1f-b702-84252bfbf0d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1466405f-2542-4b1f-b702-84252bfbf0d1', 'volume_size': 1}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-04a6a061-feb2-4587-950b-519054369861 tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-582930728: creating
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-04a6a061-feb2-4587-950b-519054369861 tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-582930728: created successfully
Sep 29 16:37:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-04a6a061-feb2-4587-950b-519054369861 tempest-GroupSnapshotsTest-839267946 None] Create group completed successfully.
Sep 29 16:37:10 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 1073741824" returned: 0 in 0.512s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:11 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51
Sep 29 16:37:11 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:11 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1949687041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1466405f-2542-4b1f-b702-84252bfbf0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1fd7bf7b79455f8289b631d6e5fa4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:10Z,use_quota=True,user_id='d6321dfedcb645adb02bbe6f519a7aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Creating volume 1466405f-2542-4b1f-b702-84252bfbf0d1 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:11 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b41ec4-5fca-4be7-ac85-bae5b6a59f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc05733-fc65-474b-96d8-c06edafdeb51', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:11 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 1073741824
Sep 29 16:37:11 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e75db0-4bac-41cc-bafd-4fcf6b570a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-9cc05733-fc65-474b-96d8-c06edafdeb51 (9cc05733-fc65-474b-96d8-c06edafdeb51): created successfully
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e75db0-4bac-41cc-bafd-4fcf6b570a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (95506e07-494e-405d-b45c-c3132fb4bc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-209649db-1f19-440c-b9a9-44f11c641d8b tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:11 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 1073741824" returned: 0 in 0.635s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:12 devstack sudo[96051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1
Sep 29 16:37:12 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:12 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (7bcedff0-fe6d-4700-9796-84bc1ab6d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7101a-54f7-478e-b30a-d7ebddf2a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7101a-54f7-478e-b30a-d7ebddf2a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124674728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=613f4259-204c-4919-9728-c1d992cd0261,host='devstack@QuobyteHD#QuobyteHD',id=c9ba7599-fd8e-482d-a47c-812a54b9d462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:12Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944ccd39-7a61-4e4f-be09-f6fe49108eab),volume_type_id=944ccd39-7a61-4e4f-be09-f6fe49108eab)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5950629-7b13-4351-8eff-96a86a79d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5950629-7b13-4351-8eff-96a86a79d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410e5130-d4f6-45fa-a548-fe4d0d59c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410e5130-d4f6-45fa-a548-fe4d0d59c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ba7599-fd8e-482d-a47c-812a54b9d462', 'volume_name': 'volume-c9ba7599-fd8e-482d-a47c-812a54b9d462', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc2252a-7032-4eac-ac2f-9ca19982e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc2252a-7032-4eac-ac2f-9ca19982e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4879d997-8442-4db2-af83-32b4fb0a63b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Volume c9ba7599-fd8e-482d-a47c-812a54b9d462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ba7599-fd8e-482d-a47c-812a54b9d462', 'volume_size': 1}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=613f4259-204c-4919-9728-c1d992cd0261,created_at=2026-09-29T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2124674728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=613f4259-204c-4919-9728-c1d992cd0261,host='devstack@QuobyteHD#QuobyteHD',id=c9ba7599-fd8e-482d-a47c-812a54b9d462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:12Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944ccd39-7a61-4e4f-be09-f6fe49108eab),volume_type_id=944ccd39-7a61-4e4f-be09-f6fe49108eab)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Creating volume c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:12 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e4e929-881d-49d2-8d06-bc7ea7874ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1466405f-2542-4b1f-b702-84252bfbf0d1', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 1073741824
Sep 29 16:37:12 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb6f15-f325-4684-97ee-50c1797d1188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Volume volume-1466405f-2542-4b1f-b702-84252bfbf0d1 (1466405f-2542-4b1f-b702-84252bfbf0d1): created successfully
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cb6f15-f325-4684-97ee-50c1797d1188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Flow 'volume_create_manager' (ca98f213-9db2-409d-9510-1cf780055ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1c7f5634-dbc6-4893-92de-e7f3a66c1950 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Created volume successfully.
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (4d36f691-9882-485d-8dfc-e51ea04eac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cf567e-6021-4837-8743-0814491351a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cf567e-6021-4837-8743-0814491351a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1738257585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7176b40-c221-4af0-bccf-a8a5bd77b129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:13Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f5b5f7-8783-4b16-bcf0-88c9973f002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f5b5f7-8783-4b16-bcf0-88c9973f002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910cbb84-a4e9-46e6-98db-7e5f4b4436aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910cbb84-a4e9-46e6-98db-7e5f4b4436aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7176b40-c221-4af0-bccf-a8a5bd77b129', 'volume_name': 'volume-e7176b40-c221-4af0-bccf-a8a5bd77b129', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b62bcb0-904a-415f-8e84-73cbf7165338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b62bcb0-904a-415f-8e84-73cbf7165338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f8277-48bc-4067-8604-96438890da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:12 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume e7176b40-c221-4af0-bccf-a8a5bd77b129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7176b40-c221-4af0-bccf-a8a5bd77b129', 'volume_size': 1}
Sep 29 16:37:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (0097a11e-bfe2-4d80-84b2-cdbc0eb5e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19195007-f048-4a33-90ef-f0170b7199b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19195007-f048-4a33-90ef-f0170b7199b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610030184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:13Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:13 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d48808-0591-498a-848d-d4d375b2d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d48808-0591-498a-848d-d4d375b2d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5523a9-e172-4c7f-a92e-1758b642af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5523a9-e172-4c7f-a92e-1758b642af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed', 'volume_name': 'volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29bd256-54a2-4ec1-b93d-ddd623b1bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29bd256-54a2-4ec1-b93d-ddd623b1bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5201371a-4850-4c78-a5b0-10f2c838fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:13 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume 3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed', 'volume_size': 1}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 1073741824" returned: 0 in 1.115s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:13 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462
Sep 29 16:37:13 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:14 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462" returned: 0 in 0.522s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1738257585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7176b40-c221-4af0-bccf-a8a5bd77b129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:13Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume e7176b40-c221-4af0-bccf-a8a5bd77b129 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:14 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:14 devstack sudo[96100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 1073741824
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (e804a266-2bfc-4b87-bb13-76251e697cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:14 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7a83c3-0d24-429d-b18f-2a77ec7a3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4879d997-8442-4db2-af83-32b4fb0a63b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ba7599-fd8e-482d-a47c-812a54b9d462', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d8616a-1d23-4014-a9e0-175a3ade8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7a83c3-0d24-429d-b18f-2a77ec7a3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1882857680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cc45fd-97a5-4161-bb3a-ce22ea6b97bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:14Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d58c6-540d-454a-a684-0f6afb7913f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d58c6-540d-454a-a684-0f6afb7913f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2597484-090c-494a-80d0-26d27773b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2597484-090c-494a-80d0-26d27773b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cc45fd-97a5-4161-bb3a-ce22ea6b97bc', 'volume_name': 'volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0956c7-95ce-4455-93f9-fa83b7e4833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0956c7-95ce-4455-93f9-fa83b7e4833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23dead-779e-412f-8d19-f0a39b3bfb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume 53cc45fd-97a5-4161-bb3a-ce22ea6b97bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc', 'volume_size': 1}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Volume volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 (c9ba7599-fd8e-482d-a47c-812a54b9d462): created successfully
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d8616a-1d23-4014-a9e0-175a3ade8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (7bcedff0-fe6d-4700-9796-84bc1ab6d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1bca916a-6a0e-45f7-b545-d40b97d20946 tempest-GroupSnapshotsTest-839267946 None] Created volume successfully.
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (c0f01f29-32e4-4698-815a-c13e7b0a908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfef3d1b-abe6-43a4-93a3-294a25159fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfef3d1b-abe6-43a4-93a3-294a25159fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835459820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa47b1c-cc6e-429d-bbfb-de186af82505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:15Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fe3439-971d-4b2a-a3d7-a8872b36f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fe3439-971d-4b2a-a3d7-a8872b36f333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c34c354-101b-4de2-8154-412e15d0f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c34c354-101b-4de2-8154-412e15d0f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa47b1c-cc6e-429d-bbfb-de186af82505', 'volume_name': 'volume-afa47b1c-cc6e-429d-bbfb-de186af82505', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c081cd5a-9e04-4ef2-a02b-9d332c4af39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c081cd5a-9e04-4ef2-a02b-9d332c4af39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ca70fe-a6a3-4988-aa93-cc7256d69e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume afa47b1c-cc6e-429d-bbfb-de186af82505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa47b1c-cc6e-429d-bbfb-de186af82505', 'volume_size': 1}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:15 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 1073741824" returned: 0 in 0.883s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:15 devstack sudo[96126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129
Sep 29 16:37:15 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (633d9c1d-2e3e-4571-a89b-b339847760b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda519d9-93ee-45b1-b7d6-5eba7c031a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda519d9-93ee-45b1-b7d6-5eba7c031a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494806654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cef3fdb-6679-46f7-92cb-a90a396d8b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:15Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2936832a-5460-4ab0-be7c-31cfa210e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2936832a-5460-4ab0-be7c-31cfa210e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0049a54a-35cf-4e4a-825d-ed1202e853a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0049a54a-35cf-4e4a-825d-ed1202e853a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cef3fdb-6679-46f7-92cb-a90a396d8b02', 'volume_name': 'volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065b10e3-2aa4-4898-93cb-7ad06d977187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065b10e3-2aa4-4898-93cb-7ad06d977187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4913d7d0-6e44-4575-a2ca-56797d9cce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume 7cef3fdb-6679-46f7-92cb-a90a396d8b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02', 'volume_size': 1}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:15 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129" returned: 0 in 0.416s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610030184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:13Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume 3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:15 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51f8277-48bc-4067-8604-96438890da0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7176b40-c221-4af0-bccf-a8a5bd77b129', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed 1073741824
Sep 29 16:37:15 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41194476-a66c-4ba0-ab27-9a9382962612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:15 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 (e7176b40-c221-4af0-bccf-a8a5bd77b129): created successfully
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41194476-a66c-4ba0-ab27-9a9382962612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (4d36f691-9882-485d-8dfc-e51ea04eac0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dfe8512e-c513-4c69-aaf8-3684edea2f11 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Acquiring lock "cinder-1466405f-2542-4b1f-b702-84252bfbf0d1-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "cinder-1466405f-2542-4b1f-b702-84252bfbf0d1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Acquiring lock "cinder-quobyte-1466405f-2542-4b1f-b702-84252bfbf0d1" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "cinder-quobyte-1466405f-2542-4b1f-b702-84252bfbf0d1" acquired by "delete_volume" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f369fe4-9278-423d-90a6-ac2157fe2ef5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:16 devstack sudo[96133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1
Sep 29 16:37:16 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (4f7e6f8d-49fb-421a-8cd6-6afe68e39e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7253a-139d-4216-92b4-96b13fd9af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7253a-139d-4216-92b4-96b13fd9af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498621002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=613f4259-204c-4919-9728-c1d992cd0261,host='devstack@QuobyteHD#QuobyteHD',id=2cf87670-aae1-4287-80d8-8a21980d3515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:16Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944ccd39-7a61-4e4f-be09-f6fe49108eab),volume_type_id=944ccd39-7a61-4e4f-be09-f6fe49108eab)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d944a-cfc6-4279-a3bb-2f9e8787071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d944a-cfc6-4279-a3bb-2f9e8787071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c233a-e05b-4161-a0c1-a4f30c2f601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c233a-e05b-4161-a0c1-a4f30c2f601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf87670-aae1-4287-80d8-8a21980d3515', 'volume_name': 'volume-2cf87670-aae1-4287-80d8-8a21980d3515', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fc08c8-2307-4c22-9452-7490cc0633c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fc08c8-2307-4c22-9452-7490cc0633c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e19844c-f2ef-416d-881d-7fb4479209dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Volume 2cf87670-aae1-4287-80d8-8a21980d3515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf87670-aae1-4287-80d8-8a21980d3515', 'volume_size': 1}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:16 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed 1073741824" returned: 0 in 1.136s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:16 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed
Sep 29 16:37:16 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:16 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1" returned: 0 in 1.062s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:17 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1
Sep 29 16:37:17 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:17 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.695s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1882857680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cc45fd-97a5-4161-bb3a-ce22ea6b97bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:14Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume 53cc45fd-97a5-4161-bb3a-ce22ea6b97bc {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:17 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5201371a-4850-4c78-a5b0-10f2c838fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a27bd2-6392-4a11-a4e0-8699f4750ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:17 devstack sudo[96146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc 1073741824
Sep 29 16:37:17 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed (3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed): created successfully
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a27bd2-6392-4a11-a4e0-8699f4750ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (0097a11e-bfe2-4d80-84b2-cdbc0eb5e40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7e095a68-da51-4e44-8263-f71a99f172fe tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:17 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1466405f-2542-4b1f-b702-84252bfbf0d1" returned: 0 in 0.319s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "cinder-quobyte-1466405f-2542-4b1f-b702-84252bfbf0d1" released by "delete_volume" :: held 1.477s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Created reservations ['4160e0a1-60b5-456b-bb2f-1e369a9e0833', '8253c87e-5a7c-442c-9b5a-b848129c59b9', 'bcb070f6-1f3d-4fbb-b6ab-a588aef268b4', 'ab924831-a816-4667-95fe-a227082f1cb2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:17 devstack sudo[96152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:17 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:17 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc 1073741824" returned: 0 in 0.542s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:17 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc
Sep 29 16:37:17 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:17 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Deleted volume successfully.
Sep 29 16:37:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c792b77e-5c7d-481a-84a2-3f9c91157a64 tempest-VolumeQuotasNegativeTestJSON-1613194125 None] Lock "cinder-1466405f-2542-4b1f-b702-84252bfbf0d1-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:18 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.067s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835459820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa47b1c-cc6e-429d-bbfb-de186af82505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:15Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume afa47b1c-cc6e-429d-bbfb-de186af82505 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:18 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23dead-779e-412f-8d19-f0a39b3bfb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f6368a-150e-408a-ae54-69684c2db86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:18 devstack sudo[96159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 1073741824
Sep 29 16:37:18 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc (53cc45fd-97a5-4161-bb3a-ce22ea6b97bc): created successfully
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f6368a-150e-408a-ae54-69684c2db86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (e804a266-2bfc-4b87-bb13-76251e697cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-fdfa3a61-af1b-4d2b-8f53-822f55722684 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:18 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 1073741824" returned: 0 in 0.818s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:19 devstack sudo[96171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505
Sep 29 16:37:19 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:19 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505" returned: 0 in 0.527s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.036s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494806654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cef3fdb-6679-46f7-92cb-a90a396d8b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2ee1894c184a5fa3813c5ac2f1e454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:15Z,use_quota=True,user_id='0d5e1297f8594995944f09b3c6d0ad2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Creating volume 7cef3fdb-6679-46f7-92cb-a90a396d8b02 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:19 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:19 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 1073741824
Sep 29 16:37:19 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ca70fe-a6a3-4988-aa93-cc7256d69e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa47b1c-cc6e-429d-bbfb-de186af82505', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfdfc62-85e7-449c-8b9f-72d2fa885c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:19 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-afa47b1c-cc6e-429d-bbfb-de186af82505 (afa47b1c-cc6e-429d-bbfb-de186af82505): created successfully
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfdfc62-85e7-449c-8b9f-72d2fa885c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (c0f01f29-32e4-4698-815a-c13e7b0a908e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-599fe8e5-2859-4df4-afc8-39c51fd86f2f tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:20 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 1073741824" returned: 0 in 0.843s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:20 devstack sudo[96191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02
Sep 29 16:37:20 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:21 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02" returned: 0 in 0.515s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.456s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=613f4259-204c-4919-9728-c1d992cd0261,created_at=2026-09-29T14:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498621002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=613f4259-204c-4919-9728-c1d992cd0261,host='devstack@QuobyteHD#QuobyteHD',id=2cf87670-aae1-4287-80d8-8a21980d3515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:16Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944ccd39-7a61-4e4f-be09-f6fe49108eab),volume_type_id=944ccd39-7a61-4e4f-be09-f6fe49108eab)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Creating volume 2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:21 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4913d7d0-6e44-4575-a2ca-56797d9cce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:21 devstack sudo[96218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 1073741824
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272fe967-b11d-42fa-b429-8749b11bf0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:21 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Volume volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 (7cef3fdb-6679-46f7-92cb-a90a396d8b02): created successfully
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272fe967-b11d-42fa-b429-8749b11bf0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Flow 'volume_create_manager' (633d9c1d-2e3e-4571-a89b-b339847760b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3a311c84-8220-468d-99bf-7ada86e5bd6e tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created volume successfully.
Sep 29 16:37:21 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 1073741824" returned: 0 in 0.760s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:22 devstack sudo[96223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515
Sep 29 16:37:22 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-7cef3fdb-6679-46f7-92cb-a90a396d8b02-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-7cef3fdb-6679-46f7-92cb-a90a396d8b02-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-7cef3fdb-6679-46f7-92cb-a90a396d8b02" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-7cef3fdb-6679-46f7-92cb-a90a396d8b02" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[310487ee-7f0b-4704-91cb-460dfea9abf0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:22 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515" returned: 0 in 0.542s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e19844c-f2ef-416d-881d-7fb4479209dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf87670-aae1-4287-80d8-8a21980d3515', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a0055f-fcac-4077-ada1-151ad03048a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:22 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Volume volume-2cf87670-aae1-4287-80d8-8a21980d3515 (2cf87670-aae1-4287-80d8-8a21980d3515): created successfully
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a0055f-fcac-4077-ada1-151ad03048a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (4f7e6f8d-49fb-421a-8cd6-6afe68e39e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:22 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e7554bf5-6e22-4d66-882a-b66619e775bf tempest-GroupSnapshotsTest-839267946 None] Created volume successfully.
Sep 29 16:37:22 devstack sudo[96226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02
Sep 29 16:37:22 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:22 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02" returned: 0 in 0.463s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:22 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02
Sep 29 16:37:22 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:23 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7cef3fdb-6679-46f7-92cb-a90a396d8b02" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-7cef3fdb-6679-46f7-92cb-a90a396d8b02" released by "delete_volume" :: held 0.882s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['a573ecf4-81e4-4b9e-82f0-a5d1379636f7', '3b6eb0a2-9d74-4828-a0a3-a3c7db1520ed', 'd696470a-93d6-4d1b-88f7-12229de28f0e', 'a06299c2-6d88-441f-92e3-8c9489c935fe'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:23 devstack sudo[96235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:23 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f940d15e-c578-4661-9d67-68909ed9c78a tempest-GroupSnapshotsTest-839267946 None] Update group completed successfully.
Sep 29 16:37:23 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.295s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b0bec33-f7d4-47dd-be60-b6af02d790cc tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-7cef3fdb-6679-46f7-92cb-a90a396d8b02-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-afa47b1c-cc6e-429d-bbfb-de186af82505-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-afa47b1c-cc6e-429d-bbfb-de186af82505-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-afa47b1c-cc6e-429d-bbfb-de186af82505" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-afa47b1c-cc6e-429d-bbfb-de186af82505" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7593e18-a719-43d5-96b8-cfae7e59c377]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:24 devstack sudo[96238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505
Sep 29 16:37:24 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7e644407-7333-4177-a7a2-2be70620953f tempest-GroupSnapshotsTest-839267946 None] Update group completed successfully.
Sep 29 16:37:25 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505" returned: 0 in 0.504s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:25 devstack sudo[96243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505
Sep 29 16:37:25 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:25 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-afa47b1c-cc6e-429d-bbfb-de186af82505" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-afa47b1c-cc6e-429d-bbfb-de186af82505" released by "delete_volume" :: held 0.830s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['183c4cae-e4be-4140-9bb6-940863de77a1', 'b0ae479d-da91-47d1-aba3-7bd655c14aaa', 'd37f570d-241a-44a7-8860-f9944ddaa828', '619e8e5f-871d-4279-9867-a8b18fc2d7bd'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:25 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:25 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5b1133-f56f-4156-b814-3e766b9440f6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:26 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.446s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:26 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc
Sep 29 16:37:26 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-70f7bc69-3b7e-4e8c-a7c8-aa7294f86040 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-afa47b1c-cc6e-429d-bbfb-de186af82505-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9ef5fcf2-7164-4e58-971d-0ee624a97c62 tempest-GroupSnapshotsTest-839267946 None] Update group completed successfully.
Sep 29 16:37:26 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" returned: 0 in 0.497s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:26 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc
Sep 29 16:37:26 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:26 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc" released by "delete_volume" :: held 0.888s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:26 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['508927ef-db3e-4599-a2b8-2997049c262f', '77de9599-7787-483d-a9c3-41f5365118f6', 'c8e878a8-4aaa-4e36-bca4-0717edebb789', 'bb29fe53-e456-41b9-8679-ebc668a2abb8'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:27 devstack sudo[96257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:27 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:27 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:27 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-78cda0fd-d45e-4b91-bf85-7edf302a1f7d tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-53cc45fd-97a5-4161-bb3a-ce22ea6b97bc-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:27 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-297a6e14-3191-401c-8ed2-da65baafd8a1 tempest-GroupSnapshotsTest-839267946 None] Update group completed successfully.
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0691c80-b082-4049-893c-35d83aa56f56]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:28 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed
Sep 29 16:37:28 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:28 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" returned: 0 in 0.446s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:28 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed
Sep 29 16:37:28 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] GroupSnapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: creating.
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Group snapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: creating. {{(pid=86843) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Creating offline snapshot 2a163361-c226-406f-bbdf-7ead70cbede1 of volume c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c62a2f-0388-47d9-b166-f22f1e82bccf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:29 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" returned: 0 in 0.357s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed" released by "delete_volume" :: held 0.862s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['d199bc60-acae-48f0-a463-c98c1d584680', 'd3e42115-a948-4e40-8b6c-d9618d02c38c', '98f7b6b1-fce0-42a5-969b-1e5a4c78c6fb', 'a9e971fe-fdaf-40ea-be05-1b50835d5bb6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:29 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462
Sep 29 16:37:29 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:29 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:29 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-e7176b40-c221-4af0-bccf-a8a5bd77b129-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-e7176b40-c221-4af0-bccf-a8a5bd77b129-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-e7176b40-c221-4af0-bccf-a8a5bd77b129" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-e7176b40-c221-4af0-bccf-a8a5bd77b129" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:29 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462" returned: 0 in 0.458s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[287039bf-6df9-4547-af7c-b9a2055b0585]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:29 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 1G
Sep 29 16:37:29 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:29 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4dc91547-49cc-4690-938a-a98739ecbc8c tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-3ed5e30a-23cb-4ac0-a7e5-139c2ac2b6ed-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:29 devstack sudo[96292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129
Sep 29 16:37:29 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:30 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129" returned: 0 in 0.486s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack sudo[96303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129
Sep 29 16:37:30 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:30 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 1G" returned: 0 in 0.574s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1
Sep 29 16:37:30 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:30 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e7176b40-c221-4af0-bccf-a8a5bd77b129" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-e7176b40-c221-4af0-bccf-a8a5bd77b129" released by "delete_volume" :: held 0.891s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['d4287c4a-0c98-482a-b81d-7c38dd7633e6', 'f81a269b-6ca0-4968-8cc7-7d16f7dbe5ed', '413641f6-5cd0-4b19-ae61-8ed6be340b15', '33dd5b2c-e712-4e5b-acb4-f4d5b06b78fd'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:30 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:30 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1
Sep 29 16:37:30 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack sudo[96313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:30 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-9cc05733-fc65-474b-96d8-c06edafdeb51-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-9cc05733-fc65-474b-96d8-c06edafdeb51-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "cinder-quobyte-9cc05733-fc65-474b-96d8-c06edafdeb51" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:30 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-9cc05733-fc65-474b-96d8-c06edafdeb51" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9cbe61-46d2-499e-b133-8e34a7ab7571]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:30 devstack sudo[96318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info
Sep 29 16:37:30 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:31 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.385s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee2ab7f3-4ad3-4aa6-bd00-342d8d8da2b1 tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-e7176b40-c221-4af0-bccf-a8a5bd77b129-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:31 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51
Sep 29 16:37:31 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:31 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:31 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:31 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info
Sep 29 16:37:31 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:31 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:31 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51
Sep 29 16:37:31 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:31 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.info" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Creating offline snapshot 3db77c00-d7d0-40a3-abd1-6eac15177522 of volume 2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ade56c-896f-4a7f-b552-b586c75f78df]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:31 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc05733-fc65-474b-96d8-c06edafdeb51" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-quobyte-9cc05733-fc65-474b-96d8-c06edafdeb51" released by "delete_volume" :: held 0.795s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Created reservations ['2db3d868-ca3f-437d-b98a-6695695ed808', '1e9e2f3b-59b5-40ff-964e-b8514b111f99', '7740d21e-1da6-4bb0-8f16-a95a9518051b', 'ff4172a2-9d59-474f-8596-91f8fe0edc0d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:31 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515
Sep 29 16:37:31 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:31 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:31 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:32 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515" returned: 0 in 0.507s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:32 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 1G
Sep 29 16:37:32 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:32 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.350s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Deleted volume successfully.
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0613f582-8247-4281-ada0-1e17669656cd tempest-CreateVolumesFromSourceVolumeTest-204864357 None] Lock "cinder-9cc05733-fc65-474b-96d8-c06edafdeb51-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:32 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 1G" returned: 0 in 0.548s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf87670-aae1-4287-80d8-8a21980d3515 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:32 devstack sudo[96347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf87670-aae1-4287-80d8-8a21980d3515 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522
Sep 29 16:37:32 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:33 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf87670-aae1-4287-80d8-8a21980d3515 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522" returned: 0 in 0.405s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:33 devstack sudo[96353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522
Sep 29 16:37:33 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:33 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:33 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info
Sep 29 16:37:33 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:33 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info" returned: 0 in 0.323s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:33 devstack sudo[96360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info
Sep 29 16:37:33 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Flow 'volume_create_manager' (3f9e5482-49a5-44b5-aca9-69a8a356f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ee8969-ed96-4ee1-899e-99e025f6cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ee8969-ed96-4ee1-899e-99e025f6cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1910520796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a24fe8b-ac47-448a-a849-7c6436782e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731131c063f4863aac82acd98ced7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:34Z,use_quota=True,user_id='c995c2a1022540e887319305d646604e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f0e83-eba5-414a-8fde-8e6c87f08e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f0e83-eba5-414a-8fde-8e6c87f08e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f3be92-6390-4bfd-81f4-26e17469238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f3be92-6390-4bfd-81f4-26e17469238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a24fe8b-ac47-448a-a849-7c6436782e8b', 'volume_name': 'volume-5a24fe8b-ac47-448a-a849-7c6436782e8b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de6e15d-08f4-424a-ab02-2ae385e567aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de6e15d-08f4-424a-ab02-2ae385e567aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3656a4-7dbc-408e-9a92-50d2a333df65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Volume 5a24fe8b-ac47-448a-a849-7c6436782e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a24fe8b-ac47-448a-a849-7c6436782e8b', 'volume_size': 1}
Sep 29 16:37:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:34 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.info" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1910520796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a24fe8b-ac47-448a-a849-7c6436782e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731131c063f4863aac82acd98ced7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:34Z,use_quota=True,user_id='c995c2a1022540e887319305d646604e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Creating volume 5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:34 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:34 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b 1073741824
Sep 29 16:37:34 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9b7729a4-a1e2-4fcf-9ad8-a72bf2c3dec3 tempest-GroupSnapshotsTest-839267946 None] group_snapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: created successfully
Sep 29 16:37:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] group_snapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: deleting
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] group_snapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: deleting {{(pid=86843) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-2a163361-c226-406f-bbdf-7ead70cbede1" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2a163361-c226-406f-bbdf-7ead70cbede1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Deleting offline snapshot 2a163361-c226-406f-bbdf-7ead70cbede1 of volume c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:37:34 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] snapshot_file for this snap is: volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b 1073741824" returned: 0 in 0.647s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[de434407-9be0-4d7b-a33b-128991e08973]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:34 devstack sudo[96370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b
Sep 29 16:37:34 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:34 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1
Sep 29 16:37:34 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:35 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b" returned: 0 in 0.313s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3656a4-7dbc-408e-9a92-50d2a333df65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a24fe8b-ac47-448a-a849-7c6436782e8b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ccdf5b-dd3d-4c5b-9b15-bbf20ed7a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Volume volume-5a24fe8b-ac47-448a-a849-7c6436782e8b (5a24fe8b-ac47-448a-a849-7c6436782e8b): created successfully
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ccdf5b-dd3d-4c5b-9b15-bbf20ed7a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Flow 'volume_create_manager' (3f9e5482-49a5-44b5-aca9-69a8a356f120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6ff021c8-122f-4a58-8561-1fa869e45f33 tempest-SnapshotMetadataTestJSON-2010593789 None] Created volume successfully.
Sep 29 16:37:35 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1" returned: 0 in 0.489s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9ba7599-fd8e-482d-a47c-812a54b9d462(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac43c7-e053-40a7-b58f-3c844767fd1b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:35 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462
Sep 29 16:37:35 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:35 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:35 devstack sudo[96383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1
Sep 29 16:37:35 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:36 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1" returned: 0 in 0.487s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Creating offline snapshot 0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 of volume 5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:37:36 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1
Sep 29 16:37:36 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b84654-8f6b-486c-ae02-49adf4f53de0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:36 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b
Sep 29 16:37:36 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:36 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462.2a163361-c226-406f-bbdf-7ead70cbede1" returned: 0 in 0.290s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2a163361-c226-406f-bbdf-7ead70cbede1" released by "_delete_snapshot" :: held 1.833s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" released by "delete_snapshot" :: held 1.863s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-3db77c00-d7d0-40a3-abd1-6eac15177522" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-3db77c00-d7d0-40a3-abd1-6eac15177522" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Deleting offline snapshot 3db77c00-d7d0-40a3-abd1-6eac15177522 of volume 2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] snapshot_file for this snap is: volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01ee95-e679-48e2-a38a-ff9c1fb0ea69]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:36 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b" returned: 0 in 0.458s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:36 devstack sudo[96400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 1G
Sep 29 16:37:36 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:36 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522
Sep 29 16:37:36 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:37 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf87670-aae1-4287-80d8-8a21980d3515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cc0a25-d373-4f4d-9ac8-34cb00129a4f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:37 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 1G" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24fe8b-ac47-448a-a849-7c6436782e8b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:37 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24fe8b-ac47-448a-a849-7c6436782e8b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43
Sep 29 16:37:37 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:37 devstack sudo[96409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515
Sep 29 16:37:37 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:37 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515" returned: 0 in 0.435s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:37 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a24fe8b-ac47-448a-a849-7c6436782e8b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" returned: 0 in 0.388s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:37 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 is being set with open permissions: ugo+rw
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:37 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522
Sep 29 16:37:37 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:37 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43
Sep 29 16:37:37 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:37 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:38 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info
Sep 29 16:37:38 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:38 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522" returned: 0 in 0.400s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:38 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522
Sep 29 16:37:38 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:38 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info" returned: 0 in 0.285s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:38 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info is being set with open permissions: ugo+rw
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:38 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info
Sep 29 16:37:38 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:38 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515.3db77c00-d7d0-40a3-abd1-6eac15177522" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-3db77c00-d7d0-40a3-abd1-6eac15177522" released by "_delete_snapshot" :: held 1.841s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" released by "delete_snapshot" :: held 1.870s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:38 devstack cinder-volume[86843]: WARNING cinder.quota [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-748326190 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-748326190, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:38 devstack cinder-volume[86843]: WARNING cinder.quota [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-748326190 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-748326190, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Created reservations ['b624016f-78fb-4370-8a47-348fa905bc9d', 'fd1fda73-bd78-4801-b1a6-c1cd0db7c74b', '77d841e9-cc55-4021-b4e1-ba6f57cb67d7', '8a805319-a277-47cf-8114-8db6cbc4b630'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:38 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.info" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Flow 'volume_create_manager' (dd560964-91fa-4de9-bb58-0a3c2659dba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4ca716-e741-4f3d-802d-24c8f9ec1c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4ca716-e741-4f3d-802d-24c8f9ec1c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6c0cc-a3ac-4105-a456-6e9aba370d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae92f90a85b4efe9cb1eef1cbedb28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:39Z,use_quota=True,user_id='9a587517194f4a53866f9049784b9594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fac4e39-ac3c-412a-8813-432dc4f4e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fac4e39-ac3c-412a-8813-432dc4f4e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1edca69-99e6-4bf6-8f3a-54077b8be6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:37:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-66b5f6ee-55ae-406a-b369-3ed13c7bbd01 tempest-SnapshotMetadataTestJSON-2010593789 None] Create snapshot completed successfully
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] Created reservations ['8b36ca58-0d8b-4074-b4a3-d11d8a2830f0', '679bb655-1551-45da-8cd1-63694bebde84', '94f6055c-7c9b-4e8c-960a-111ffbb6ea2d', '23407795-3cee-481e-838f-b663c6c367d7'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a9856ffa-dde8-4a88-8fae-d716f3a17653 tempest-GroupSnapshotsTest-839267946 None] group_snapshot 6ba9f22d-1c5b-4802-9331-7b26a4898130: deleted successfully
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1edca69-99e6-4bf6-8f3a-54077b8be6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dad6c0cc-a3ac-4105-a456-6e9aba370d32', 'volume_name': 'volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32', 'volume_size': 1, 'image_id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cc41a671937b9fd2c44c9a8637a72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ae92f90a85b4efe9cb1eef1cbedb28d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbe3da68e6d65cd5936f4fda82a8ec8388b993820cc1488ae7200aa1c27bd6cf8ae7b956c56d3d768503c7b93b0aec132e6d2ec98d3c5d29d51858ad0eccaccd', 'id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'created_at': datetime.datetime(2026, 9, 29, 14, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27c7117c-a40e-486f-a13c-8bd177df9e7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7da7140>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b39ef-2170-47a8-a592-f5d2b33dff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b39ef-2170-47a8-a592-f5d2b33dff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddaf95-c481-4a57-b630-2bbcaa8ac785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Volume dad6c0cc-a3ac-4105-a456-6e9aba370d32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32', 'volume_size': 1, 'image_id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cc41a671937b9fd2c44c9a8637a72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ae92f90a85b4efe9cb1eef1cbedb28d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbe3da68e6d65cd5936f4fda82a8ec8388b993820cc1488ae7200aa1c27bd6cf8ae7b956c56d3d768503c7b93b0aec132e6d2ec98d3c5d29d51858ad0eccaccd', 'id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'created_at': datetime.datetime(2026, 9, 29, 14, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27c7117c-a40e-486f-a13c-8bd177df9e7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7da7140>}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Trying to clone dad6c0cc-a3ac-4105-a456-6e9aba370d32 from image 27c7117c-a40e-486f-a13c-8bd177df9e7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:37:39 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75958ce-c4a0-47c8-8876-7cd381519d99]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:39 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:39 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:39 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:39 devstack sudo[96450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:39 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" acquired by "delete_volume" :: waited 0.040s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee4b59a-137f-4b73-ab59-cfcd86fe5ec3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:39 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:37:39 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Temporary image 27c7117c-a40e-486f-a13c-8bd177df9e7c is fetched for user 9a587517194f4a53866f9049784b9594. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:37:40 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515
Sep 29 16:37:40 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe962b2b-70e7-47da-9469-162e52da2bd1]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:40 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:40 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:40 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515" returned: 0 in 0.628s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "cinder-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:40 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515
Sep 29 16:37:40 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:40 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "cinder-quobyte-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Deleting offline snapshot 0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 of volume 5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] snapshot_file for this snap is: volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a5ff08-d02a-4df3-b441-698d2716cbfb]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:40 devstack sudo[96495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:40 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:40 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2cf87670-aae1-4287-80d8-8a21980d3515" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:40 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43
Sep 29 16:37:40 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-2cf87670-aae1-4287-80d8-8a21980d3515" released by "delete_volume" :: held 1.142s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:41 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6c0cc-a3ac-4105-a456-6e9aba370d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae92f90a85b4efe9cb1eef1cbedb28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:39Z,use_quota=True,user_id='9a587517194f4a53866f9049784b9594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Creating volume dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:41 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b7a48d-7d27-422c-a04a-643b34361e3e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:41 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1073741824
Sep 29 16:37:41 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:41 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462
Sep 29 16:37:41 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:41 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" returned: 0 in 0.695s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a24fe8b-ac47-448a-a849-7c6436782e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fd15d-e1fb-4233-832a-e8c17ab5c387]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:41 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462" returned: 0 in 0.587s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:41 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b
Sep 29 16:37:41 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:41 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462
Sep 29 16:37:41 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:41 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1073741824" returned: 0 in 0.861s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:42 devstack sudo[96549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32
Sep 29 16:37:42 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:42 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c9ba7599-fd8e-482d-a47c-812a54b9d462" returned: 0 in 0.483s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:42 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b" returned: 0 in 0.695s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-c9ba7599-fd8e-482d-a47c-812a54b9d462" released by "delete_volume" :: held 1.227s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:42 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43
Sep 29 16:37:42 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Created reservations ['a95b34ff-e2db-4bad-ad93-1360879a46dd'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:42 devstack cinder-volume[86843]: WARNING cinder.quota [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-748326190 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-748326190, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:42 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Created reservations ['1508c459-09fb-437b-8da2-986adb129d87', 'd9cd9b60-a402-4bb4-98dd-664c5b80ee45', 'c41e75d7-1d28-4f81-9a84-327b55f24631', 'ff67e749-3dfa-49e2-8329-21b9794259a9'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Attempting download of 27c7117c-a40e-486f-a13c-8bd177df9e7c ((None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}])) to volume dad6c0cc-a3ac-4105-a456-6e9aba370d32. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b5827-0523-4fd7-9e5f-c745dc9b820b]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Created reservations ['59389b5d-028e-41fe-8421-223aa3f4b03a', '63c805c1-56e2-410f-9cb5-c2c2f89f44f5', '3403489c-1401-49fa-a763-397cac079bf6', 'ad196ed2-67d1-458a-aad0-ee86e6fd2faa'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:42 devstack sudo[96559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na
Sep 29 16:37:42 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:42 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" returned: 0 in 0.592s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:42 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:42 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:42 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43
Sep 29 16:37:42 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:43 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na" returned: 0 in 0.487s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:43 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.364s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dfa85831-6edb-4472-b3ac-dfaf6fe4ba4a tempest-GroupSnapshotsTest-839267946 None] Delete group completed successfully.
Sep 29 16:37:43 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b.0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" returned: 0 in 0.372s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43" released by "_delete_snapshot" :: held 2.522s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:43 devstack sudo[96573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na
Sep 29 16:37:43 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" released by "delete_snapshot" :: held 2.561s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Created reservations ['e43d80d1-3f00-4286-b7ab-ff4dd9862257', 'c5bdc0dd-47f9-4e65-b9e8-6653fe0b265c', '987087bd-0574-43b6-aab8-bfd4cab2656c', '1dbcd22e-094b-41a2-83ad-58c816478f47'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Delete snapshot completed successfully.
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b89e6e5a-5cb3-4820-8511-4bb35f343f5a tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-0f6bd68b-f7e2-49a0-b8b2-2a5134d8bd43-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:43 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na" returned: 1 in 0.419s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27c7117c-a40e-486f-a13c-8bd177df9e7c_60va41na' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfefef3-7bff-4ee2-8383-33e43c96c088]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:43 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:43 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:43 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "cinder-5a24fe8b-ac47-448a-a849-7c6436782e8b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-5a24fe8b-ac47-448a-a849-7c6436782e8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:43 devstack sudo[96584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD
Sep 29 16:37:43 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a9f7f-4726-4b5f-8cd6-f914cc78ed1f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-552da4dd-92d4-47ae-8bf1-8021da3bffa0 tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-1754564124: creating
Sep 29 16:37:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-552da4dd-92d4-47ae-8bf1-8021da3bffa0 tempest-GroupSnapshotsTest-839267946 None] Group tempest-GroupSnapshotsTest-Group-1754564124: created successfully
Sep 29 16:37:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-552da4dd-92d4-47ae-8bf1-8021da3bffa0 tempest-GroupSnapshotsTest-839267946 None] Create group completed successfully.
Sep 29 16:37:44 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b
Sep 29 16:37:44 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:44 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] 27c7117c-a40e-486f-a13c-8bd177df9e7c was raw, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:44 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32
Sep 29 16:37:44 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:44 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b" returned: 0 in 0.387s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:44 devstack sudo[96598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b
Sep 29 16:37:44 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:44 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:44 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32" returned: 0 in 0.482s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27c7117c-a40e-486f-a13c-8bd177df9e7c_hfc929uzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:37:44 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5a24fe8b-ac47-448a-a849-7c6436782e8b" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:44 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1G
Sep 29 16:37:44 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-quobyte-5a24fe8b-ac47-448a-a849-7c6436782e8b" released by "delete_volume" :: held 0.782s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Created reservations ['0763870d-24f0-4f0c-bf4b-0225c8ee88f4', '86a4fe4d-68f0-4908-985a-b0cbecc58fb1', 'f9a77a06-39b9-49cf-a8dd-736f6c9ab585', '31eb7155-bb6a-475f-a067-9b38ee6ec9f6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:44 devstack sudo[96604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:44 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:45 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 1G" returned: 0 in 0.471s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Downloaded image 27c7117c-a40e-486f-a13c-8bd177df9e7c ((None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}])) to volume dad6c0cc-a3ac-4105-a456-6e9aba370d32 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Temporary image 27c7117c-a40e-486f-a13c-8bd177df9e7c for user 9a587517194f4a53866f9049784b9594 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Marking volume dad6c0cc-a3ac-4105-a456-6e9aba370d32 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Copying metadata from image 27c7117c-a40e-486f-a13c-8bd177df9e7c to dad6c0cc-a3ac-4105-a456-6e9aba370d32. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Creating volume glance metadata for volume dad6c0cc-a3ac-4105-a456-6e9aba370d32 backed by image 27c7117c-a40e-486f-a13c-8bd177df9e7c with: {'image_id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38cc41a671937b9fd2c44c9a8637a72e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:37:45 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Deleted volume successfully.
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-627cfd46-1f35-4369-bb83-8b05d911a21c tempest-SnapshotMetadataTestJSON-2010593789 None] Lock "cinder-5a24fe8b-ac47-448a-a849-7c6436782e8b-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddaf95-c481-4a57-b630-2bbcaa8ac785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32', 'volume_size': 1, 'image_id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27c7117c-a40e-486f-a13c-8bd177df9e7c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cc41a671937b9fd2c44c9a8637a72e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ae92f90a85b4efe9cb1eef1cbedb28d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbe3da68e6d65cd5936f4fda82a8ec8388b993820cc1488ae7200aa1c27bd6cf8ae7b956c56d3d768503c7b93b0aec132e6d2ec98d3c5d29d51858ad0eccaccd', 'id': '27c7117c-a40e-486f-a13c-8bd177df9e7c', 'created_at': datetime.datetime(2026, 9, 29, 14, 37, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27c7117c-a40e-486f-a13c-8bd177df9e7c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7da7140>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a36f8b3-3f81-4f9f-8248-5d93f36db83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Volume volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 (dad6c0cc-a3ac-4105-a456-6e9aba370d32): created successfully
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a36f8b3-3f81-4f9f-8248-5d93f36db83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Flow 'volume_create_manager' (dd560964-91fa-4de9-bb58-0a3c2659dba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3c4f92b2-2d6a-4976-90c4-13a1fee7f57c tempest-VolumeImageDependencyTests-1157903430 None] Created volume successfully.
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (fca2180a-30c4-46e2-a40b-6cad67ae322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369a2a8a-b821-486a-8892-3fc98a6a610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369a2a8a-b821-486a-8892-3fc98a6a610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987522414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d367c766-de83-4791-b15f-23b9d529a865,host='devstack@QuobyteHD#QuobyteHD',id=bae3519a-077e-4bc8-b6f5-47a93bcc6190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:46Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(661b0a87-9945-468a-a381-0cf9804be5f3),volume_type_id=661b0a87-9945-468a-a381-0cf9804be5f3)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78593348-f04e-44e3-bed7-fa5260da8ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78593348-f04e-44e3-bed7-fa5260da8ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8833f6-71f6-4be2-9d41-ad8a900bc10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8833f6-71f6-4be2-9d41-ad8a900bc10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae3519a-077e-4bc8-b6f5-47a93bcc6190', 'volume_name': 'volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96a6404-6c0f-4e87-aa4f-96ebd914da9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96a6404-6c0f-4e87-aa4f-96ebd914da9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e505619a-02e8-4922-81d7-d6e3350add8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Volume bae3519a-077e-4bc8-b6f5-47a93bcc6190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190', 'volume_size': 1}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d367c766-de83-4791-b15f-23b9d529a865,created_at=2026-09-29T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987522414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d367c766-de83-4791-b15f-23b9d529a865,host='devstack@QuobyteHD#QuobyteHD',id=bae3519a-077e-4bc8-b6f5-47a93bcc6190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202dbe5cc4d343e386bcb7d90a27b907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:46Z,use_quota=True,user_id='37434802e06a4471a178409908480d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(661b0a87-9945-468a-a381-0cf9804be5f3),volume_type_id=661b0a87-9945-468a-a381-0cf9804be5f3)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Creating volume bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:45 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:45 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 1073741824
Sep 29 16:37:46 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Acquiring lock "cinder-dad6c0cc-a3ac-4105-a456-6e9aba370d32-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "cinder-dad6c0cc-a3ac-4105-a456-6e9aba370d32-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Acquiring lock "cinder-quobyte-dad6c0cc-a3ac-4105-a456-6e9aba370d32" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "cinder-quobyte-dad6c0cc-a3ac-4105-a456-6e9aba370d32" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c89b5b-ab32-4d9d-80dd-29b18e1fe3e3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:46 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 1073741824" returned: 0 in 0.640s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:46 devstack sudo[96617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32
Sep 29 16:37:46 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:46 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190
Sep 29 16:37:46 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-92bdd0a2-b1ff-4f99-b3db-26040a2ae54a req-19e9a932-44bc-421f-b360-4efa40e089dc tempest-AttachVolumeNegativeTest-1073949744 None] Terminate volume connection completed successfully.
Sep 29 16:37:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-92bdd0a2-b1ff-4f99-b3db-26040a2ae54a req-19e9a932-44bc-421f-b360-4efa40e089dc tempest-AttachVolumeNegativeTest-1073949744 None] Deleting attachment 93bda3ae-0e23-4d3b-a443-57a84dff191e. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:37:47 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32" returned: 0 in 0.488s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:47 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32
Sep 29 16:37:47 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:47 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190" returned: 0 in 0.462s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e505619a-02e8-4922-81d7-d6e3350add8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bf329f-f25c-4c12-be3f-f6db99c075d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Volume volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 (bae3519a-077e-4bc8-b6f5-47a93bcc6190): created successfully
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28bf329f-f25c-4c12-be3f-f6db99c075d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Flow 'volume_create_manager' (fca2180a-30c4-46e2-a40b-6cad67ae322f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9968ae87-39cc-4626-b5c7-9938b5db384b tempest-GroupSnapshotsTest-839267946 None] Created volume successfully.
Sep 29 16:37:47 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-dad6c0cc-a3ac-4105-a456-6e9aba370d32" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "cinder-quobyte-dad6c0cc-a3ac-4105-a456-6e9aba370d32" released by "delete_volume" :: held 0.970s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Created reservations ['967871fd-5bcb-4656-8b1e-03bdca6e795d', '3f8bbc33-2d39-49cb-9636-d4454d340021', '9f9e7801-b2f9-4b6e-b11a-a80a4405e0b5', '297c6a43-80b3-42dc-a25f-57488a6a572a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:47 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:47 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:48 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:48 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Deleted volume successfully.
Sep 29 16:37:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8468a141-b97b-4c97-bb9c-ee0103d51f46 tempest-VolumeImageDependencyTests-1157903430 None] Lock "cinder-dad6c0cc-a3ac-4105-a456-6e9aba370d32-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] GroupSnapshot b445e273-4ed2-4f85-a490-e901a16bc496: creating.
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Group snapshot b445e273-4ed2-4f85-a490-e901a16bc496: creating. {{(pid=86843) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Creating offline snapshot 9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 of volume bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd462a7-b540-4e17-8ced-4a15d05b3840]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:49 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190
Sep 29 16:37:49 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:49 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190" returned: 0 in 0.544s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:49 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 1G
Sep 29 16:37:49 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:50 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 1G" returned: 0 in 0.795s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:50 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665
Sep 29 16:37:50 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:50 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Flow 'volume_create_manager' (0de5d5a9-4ce0-40a9-854f-497771abb363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1580d4a-3809-402c-b534-2b2fc698e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1580d4a-3809-402c-b534-2b2fc698e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-555866697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabd43f4-c10d-45b2-8b1f-08dddf67e039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa2696dfc3e468a9ebe0ad913af930d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:51Z,use_quota=True,user_id='97167fca0318465b9a14ce5bfb096f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:51 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aefc3b-66ef-481f-b585-3f685d6a9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aefc3b-66ef-481f-b585-3f685d6a9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e21be5-2d9d-431f-868a-0bc771742e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e21be5-2d9d-431f-868a-0bc771742e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'volume_name': 'volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9edd24-4fd3-4a31-8184-b1652ac47778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9edd24-4fd3-4a31-8184-b1652ac47778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f57892-fb7a-4dae-b578-2636ccd9c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:51 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Volume fabd43f4-c10d-45b2-8b1f-08dddf67e039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'volume_size': 1}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" returned: 0 in 0.468s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:51 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665
Sep 29 16:37:51 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:51 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" returned: 0 in 0.292s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:51 devstack sudo[96690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info
Sep 29 16:37:51 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:51 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:51 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info
Sep 29 16:37:51 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:51 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.info" returned: 0 in 0.293s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-555866697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabd43f4-c10d-45b2-8b1f-08dddf67e039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa2696dfc3e468a9ebe0ad913af930d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:51Z,use_quota=True,user_id='97167fca0318465b9a14ce5bfb096f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Creating volume fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:37:51 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:37:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:52 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 1073741824
Sep 29 16:37:52 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-27cbf1bd-77f0-4c3b-bfa6-ffc8c5474fa7 tempest-GroupSnapshotsTest-839267946 None] group_snapshot b445e273-4ed2-4f85-a490-e901a16bc496: created successfully
Sep 29 16:37:52 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 1073741824" returned: 0 in 0.637s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] group_snapshot b445e273-4ed2-4f85-a490-e901a16bc496: deleting
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] group_snapshot b445e273-4ed2-4f85-a490-e901a16bc496: deleting {{(pid=86843) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 16:37:52 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:37:52 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Deleting offline snapshot 9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 of volume bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] snapshot_file for this snap is: volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdf845-96d2-4c93-b1a4-3392f09f4878]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:53 devstack sudo[96705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665
Sep 29 16:37:53 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:53 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.383s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f57892-fb7a-4dae-b578-2636ccd9c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fd64b1-c73a-4ce3-b655-983a55bd8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Volume volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 (fabd43f4-c10d-45b2-8b1f-08dddf67e039): created successfully
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fd64b1-c73a-4ce3-b655-983a55bd8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Flow 'volume_create_manager' (0de5d5a9-4ce0-40a9-854f-497771abb363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5185f219-5979-488c-9ec4-85674ea7f0e0 tempest-VolumesCloneTest-1969518375 None] Created volume successfully.
Sep 29 16:37:53 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" returned: 0 in 0.512s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1bf24-f9e6-4316-a179-7c793e729402]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:53 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:53 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:53 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190
Sep 29 16:37:53 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:53 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:37:53 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190" returned: 0 in 0.471s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:53 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665
Sep 29 16:37:53 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:54 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" returned: 0 in 0.507s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:54 devstack sudo[96725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665
Sep 29 16:37:54 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:54 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190.9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" returned: 0 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-9b5a6345-de34-4a84-b1a0-c0bd3d5d8665" released by "_delete_snapshot" :: held 2.020s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" released by "delete_snapshot" :: held 2.061s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Flow 'volume_create_manager' (95b3678c-2af1-4db9-ba58-71e363b9243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f6ee9-f209-4b05-9ac3-ab9d43d4ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f6ee9-f209-4b05-9ac3-ab9d43d4ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1741979090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d3c74e-66ed-4063-984f-e98db760e548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa2696dfc3e468a9ebe0ad913af930d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=fabd43f4-c10d-45b2-8b1f-08dddf67e039,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:55Z,use_quota=True,user_id='97167fca0318465b9a14ce5bfb096f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee371ec7-d839-41df-97e5-be305184baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee371ec7-d839-41df-97e5-be305184baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4312272c-b38f-44ad-85a1-1b4274cf40fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4312272c-b38f-44ad-85a1-1b4274cf40fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c8d3c74e-66ed-4063-984f-e98db760e548', 'volume_name': 'volume-c8d3c74e-66ed-4063-984f-e98db760e548', 'volume_size': 2, 'source_volid': 'fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'source_volstatus': 'available'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109c41fb-fd9c-4d93-9649-a436f4819fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109c41fb-fd9c-4d93-9649-a436f4819fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e76c8-8b50-4e1f-91b4-e9d6a01e4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:37:55 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Volume c8d3c74e-66ed-4063-984f-e98db760e548: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c8d3c74e-66ed-4063-984f-e98db760e548', 'volume_size': 2, 'source_volid': 'fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'source_volstatus': 'available'}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:55 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Cloning volume fabd43f4-c10d-45b2-8b1f-08dddf67e039 to volume c8d3c74e-66ed-4063-984f-e98db760e548
Sep 29 16:37:55 devstack cinder-volume[86843]: WARNING cinder.quota [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-230121477 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-230121477, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:55 devstack cinder-volume[86843]: WARNING cinder.quota [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-230121477 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-230121477, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Creating offline snapshot 8f6925c4-1db3-4882-a555-71d76dc8c10d of volume fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] Created reservations ['728388b5-cb9a-492f-af61-97e44bf211d2', '45131739-7714-4218-85a2-01cc19e409a9', '219ad5ff-5b4e-428d-8a32-df85870ea431', '36644fb9-6a88-4695-9b26-a676461d8214'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f091ea-d462-4fcb-a796-e604e8465af7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-328b1f1d-d9ca-43b7-b9df-ed80eb2aba56 tempest-GroupSnapshotsTest-839267946 None] group_snapshot b445e273-4ed2-4f85-a490-e901a16bc496: deleted successfully
Sep 29 16:37:55 devstack sudo[96728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:37:55 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:55 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.434s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:55 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d 1G
Sep 29 16:37:55 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:56 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d 1G" returned: 0 in 0.596s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:56 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:37:56 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:56 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.422s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:56 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d is being set with open permissions: ugo+rw
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:56 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:37:56 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52a6d9-adc7-4928-b386-11c6a39edab5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:57 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.406s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:57 devstack sudo[96757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info
Sep 29 16:37:57 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:57 devstack sudo[96756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190
Sep 29 16:37:57 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:57 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:57 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info is being set with open permissions: ugo+rw
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:57 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info
Sep 29 16:37:57 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:57 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190" returned: 0 in 0.638s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:57 devstack sudo[96767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190
Sep 29 16:37:57 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:57 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.info" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] snapshot: 8f6925c4-1db3-4882-a555-71d76dc8c10d, volume: c8d3c74e-66ed-4063-984f-e98db760e548,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:58 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[009101f3-387b-4ed4-9668-5ae6c7be6bcf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bae3519a-077e-4bc8-b6f5-47a93bcc6190" returned: 0 in 0.542s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Lock "cinder-quobyte-bae3519a-077e-4bc8-b6f5-47a93bcc6190" released by "delete_volume" :: held 1.317s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:37:58 devstack sudo[96784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:37:58 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Created reservations ['0c336e21-4bc4-4639-935e-1d8e7070866f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:58 devstack cinder-volume[86843]: WARNING cinder.quota [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-230121477 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-230121477, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Created reservations ['bc0b486f-f427-46e4-9694-224edd5e6c6f', '72a0e72a-3251-4880-9ae6-e604b43b2916', '6bc31f94-9044-4ee1-8ce7-12c603095696', '66edf672-5726-4ced-99ee-bef4f9e4fc84'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:58 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:37:58 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:58 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.703s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[54542814-b270-4d3e-8d42-db1aa25dc38b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:37:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:59 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:37:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-104e6055-e3f6-4b54-bd00-52e1c6dbf5fa tempest-GroupSnapshotsTest-839267946 None] Delete group completed successfully.
Sep 29 16:37:59 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:37:59 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:37:59 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.444s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:37:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:37:59 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548
Sep 29 16:37:59 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:08 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=211,cinder:SELECT=173,cinder:INSERT=56,cinder:DELETE=10 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:38:08 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=185,cinder:INSERT=52,cinder:UPDATE=203,cinder:DELETE=13 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:38:11 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548" returned: 0 in 11.688s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039, size 1024.00 MB, duration 11.69 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:38:11 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Converted 1024.00 MB image at 87.60 MB/s
Sep 29 16:38:11 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 is being set with open permissions: ugo+rw
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:11 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548
Sep 29 16:38:11 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:11 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548" returned: 0 in 0.673s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" released by "_copy_volume_from_snapshot" :: held 13.663s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-quobyte-8f6925c4-1db3-4882-a555-71d76dc8c10d" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-8f6925c4-1db3-4882-a555-71d76dc8c10d" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Deleting offline snapshot 8f6925c4-1db3-4882-a555-71d76dc8c10d of volume fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] snapshot_file for this snap is: volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[24947ea1-a0f8-420f-8503-3c7e630c48d8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:12 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:38:12 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:12 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.629s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:38:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c550d-90aa-49c2-8d6a-8230374de72d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:12 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:38:12 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:13 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.786s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:13 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:38:13 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:13 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.577s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:13 devstack sudo[96928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d
Sep 29 16:38:13 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:14 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039.8f6925c4-1db3-4882-a555-71d76dc8c10d" returned: 0 in 0.410s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-8f6925c4-1db3-4882-a555-71d76dc8c10d" released by "_delete_snapshot" :: held 2.556s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.382s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e76c8-8b50-4e1f-91b4-e9d6a01e4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d3c74e-66ed-4063-984f-e98db760e548', 'volume_size': 2, 'source_volid': 'fabd43f4-c10d-45b2-8b1f-08dddf67e039', 'source_volstatus': 'available'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01590c-83a4-4810-b6b8-ba99916e77d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Volume volume-c8d3c74e-66ed-4063-984f-e98db760e548 (c8d3c74e-66ed-4063-984f-e98db760e548): created successfully
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e01590c-83a4-4810-b6b8-ba99916e77d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Flow 'volume_create_manager' (95b3678c-2af1-4db9-ba58-71e363b9243b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6c511030-5c57-4bf2-abff-3f0c300278dc tempest-VolumesCloneTest-1969518375 None] Created volume successfully.
Sep 29 16:38:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dd191f5f-d6a5-4561-91bc-25b6d7e3e9bd tempest-GroupsV314Test-1137772429 None] Group tempest-GroupsV314Test-Group-933284314: creating
Sep 29 16:38:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dd191f5f-d6a5-4561-91bc-25b6d7e3e9bd tempest-GroupsV314Test-1137772429 None] Group tempest-GroupsV314Test-Group-933284314: created successfully
Sep 29 16:38:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dd191f5f-d6a5-4561-91bc-25b6d7e3e9bd tempest-GroupsV314Test-1137772429 None] Create group completed successfully.
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-c8d3c74e-66ed-4063-984f-e98db760e548-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "cinder-c8d3c74e-66ed-4063-984f-e98db760e548-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" acquired by "delete_volume" :: waited 0.039s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee99d43-a100-4c44-9be6-db9cebad1b17]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:15 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548
Sep 29 16:38:15 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:15 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548" returned: 0 in 0.405s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:15 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548
Sep 29 16:38:15 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:16 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c8d3c74e-66ed-4063-984f-e98db760e548" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-c8d3c74e-66ed-4063-984f-e98db760e548" released by "delete_volume" :: held 0.736s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Created reservations ['1bddef4a-6f1d-4039-89a6-5f3cb6b0da2e', '65ecfa26-aedc-4db2-9ca3-e1d1656755a7', '50119ffd-7416-4e11-997e-c37fe4f7a43a', '30f3c7e1-e33d-4db6-a3fd-0083da7c603f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:16 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:16 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-fabd43f4-c10d-45b2-8b1f-08dddf67e039-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:16 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "cinder-fabd43f4-c10d-45b2-8b1f-08dddf67e039-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.530s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Deleted volume successfully.
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9e7d7ff-0b88-4315-a985-4c46b9d0339a tempest-VolumesCloneTest-1969518375 None] Lock "cinder-c8d3c74e-66ed-4063-984f-e98db760e548-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Acquiring lock "cinder-quobyte-fabd43f4-c10d-45b2-8b1f-08dddf67e039" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-fabd43f4-c10d-45b2-8b1f-08dddf67e039" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad557a-268f-4cbe-ad8b-fca3a58c8156]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Flow 'volume_create_manager' (682a706c-1fe8-4cb8-80b5-9e0bcc7ded5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d58d34b-46c0-451c-ba2b-ccd667f5cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d58d34b-46c0-451c-ba2b-ccd667f5cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765864162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0111e34-cbc4-496f-b500-9b6cd3f4efed,host='devstack@QuobyteHD#QuobyteHD',id=c56f0d8f-2f74-4e2e-8955-54bb13b5a465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d7af5cf1044e8ad3acc86ddffa9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:17Z,use_quota=True,user_id='25df21bc5244410a86f3de4905e10b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d8be16-d3ac-4b50-a7f2-fb83915bc24c),volume_type_id=f2d8be16-d3ac-4b50-a7f2-fb83915bc24c)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f296ae3-c54a-4e99-94df-b2dd232cfecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f296ae3-c54a-4e99-94df-b2dd232cfecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a00f4ff-4e3f-4ea4-bd46-bda7b9cd9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a00f4ff-4e3f-4ea4-bd46-bda7b9cd9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56f0d8f-2f74-4e2e-8955-54bb13b5a465', 'volume_name': 'volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c448f-1f0b-431e-a6ca-ed18912f9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c448f-1f0b-431e-a6ca-ed18912f9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790f00af-12cd-4b34-a25b-765ce99a201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Volume c56f0d8f-2f74-4e2e-8955-54bb13b5a465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465', 'volume_size': 1}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b0111e34-cbc4-496f-b500-9b6cd3f4efed,created_at=2026-09-29T14:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765864162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b0111e34-cbc4-496f-b500-9b6cd3f4efed,host='devstack@QuobyteHD#QuobyteHD',id=c56f0d8f-2f74-4e2e-8955-54bb13b5a465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21d7af5cf1044e8ad3acc86ddffa9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:17Z,use_quota=True,user_id='25df21bc5244410a86f3de4905e10b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d8be16-d3ac-4b50-a7f2-fb83915bc24c),volume_type_id=f2d8be16-d3ac-4b50-a7f2-fb83915bc24c)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Creating volume c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:38:17 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:17 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 1073741824
Sep 29 16:38:17 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:17 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:38:17 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:17 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.592s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:17 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039
Sep 29 16:38:17 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:17 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 1073741824" returned: 0 in 0.571s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:17 devstack sudo[96955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:17 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:18 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fabd43f4-c10d-45b2-8b1f-08dddf67e039" returned: 0 in 0.394s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "cinder-quobyte-fabd43f4-c10d-45b2-8b1f-08dddf67e039" released by "delete_volume" :: held 1.129s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Created reservations ['84f7511c-a5cc-4aa3-ae80-5f5e642313c7', '9dcf5ed7-392a-4e42-afe8-b193696a64f2', '80556fae-0803-4615-8e59-936cdcc9cee5', '0500db3e-2da5-4489-a6cc-d5894885e1a0'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:18 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:18 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:18 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790f00af-12cd-4b34-a25b-765ce99a201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afe6648-8dcc-4722-8630-f8446fc88daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Volume volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 (c56f0d8f-2f74-4e2e-8955-54bb13b5a465): created successfully
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afe6648-8dcc-4722-8630-f8446fc88daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Flow 'volume_create_manager' (682a706c-1fe8-4cb8-80b5-9e0bcc7ded5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-68576d27-b4bf-49ec-a22d-17a473db5aba tempest-GroupsV314Test-1137772429 None] Created volume successfully.
Sep 29 16:38:18 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.388s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Deleted volume successfully.
Sep 29 16:38:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77d39fb7-9f27-42aa-b151-83ddc80021f9 tempest-VolumesCloneTest-1969518375 None] Lock "cinder-fabd43f4-c10d-45b2-8b1f-08dddf67e039-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:20 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Cloning volume c56f0d8f-2f74-4e2e-8955-54bb13b5a465 to volume 9b4aaa04-f7a7-4bb7-a900-e151ef12f84d
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Creating offline snapshot f96876c7-0212-4462-8568-23cde2612e02 of volume c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d9e8c-f92d-4a21-b472-62051a8b9d15]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:20 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:20 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:20 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.549s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:20 devstack sudo[96997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 1G
Sep 29 16:38:20 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:21 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 1G" returned: 0 in 0.520s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:21 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:21 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:21 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:21 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:21 devstack sudo[97008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:21 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:21 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:21 devstack sudo[97011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info
Sep 29 16:38:21 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:22 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info" returned: 0 in 0.305s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:22 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:22 devstack sudo[97014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info
Sep 29 16:38:22 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:22 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.info" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Acquiring lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] snapshot: f96876c7-0212-4462-8568-23cde2612e02, volume: 9b4aaa04-f7a7-4bb7-a900-e151ef12f84d,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b430d344-57ed-4a9a-bcc1-1dab94ab10e3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:22 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:22 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:23 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.503s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42e2f81-acc2-4f9a-b39c-e9845dd4e59d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:23 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:23 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:23 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.464s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:38:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:23 devstack sudo[97028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d
Sep 29 16:38:23 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=22,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:38:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=26,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Flow 'volume_create_manager' (8f89e614-fb4f-4800-9acf-15cc09118547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c29ff26-c33d-4b0c-9a76-a81946bf3ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c29ff26-c33d-4b0c-9a76-a81946bf3ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-866682202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec19e3-cdf1-4661-a47c-c49f456d91dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1444ab7d7134285961c8f67b3061022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:32Z,use_quota=True,user_id='4fccdb3745de4fee8e2d546b37a6752b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1920e599-1ae0-4c1c-a6d3-0bc3a9b42aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1920e599-1ae0-4c1c-a6d3-0bc3a9b42aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d606072-efa6-4c04-9c98-92e291fc7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d606072-efa6-4c04-9c98-92e291fc7b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ec19e3-cdf1-4661-a47c-c49f456d91dd', 'volume_name': 'volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd', 'volume_size': 2}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359bb2ee-f550-4493-aa29-c577fb2d5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359bb2ee-f550-4493-aa29-c577fb2d5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbda4ad-5124-48c4-8dd8-cde66e801fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Volume 31ec19e3-cdf1-4661-a47c-c49f456d91dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd', 'volume_size': 2}
Sep 29 16:38:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (e07b223a-b48f-46d1-a092-e67af9553528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fdce2f-0c14-4ab7-bd2b-2875a46555e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fdce2f-0c14-4ab7-bd2b-2875a46555e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1872575041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d12038-a23f-4003-b072-66be301323ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:33Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77a204-0432-4c98-8562-6ccfdd4f699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77a204-0432-4c98-8562-6ccfdd4f699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73754d3-e1b7-49b2-8c6c-6ecd5c7d997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73754d3-e1b7-49b2-8c6c-6ecd5c7d997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d12038-a23f-4003-b072-66be301323ad', 'volume_name': 'volume-04d12038-a23f-4003-b072-66be301323ad', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167f8816-aeea-4eae-a7f5-46eb46581e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167f8816-aeea-4eae-a7f5-46eb46581e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c2922f-0cfe-446a-adec-7c44c985ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Volume 04d12038-a23f-4003-b072-66be301323ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d12038-a23f-4003-b072-66be301323ad', 'volume_size': 1}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:33 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" returned: 0 in 9.910s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465, size 1024.00 MB, duration 9.91 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:38:33 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Converted 1024.00 MB image at 103.31 MB/s
Sep 29 16:38:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:33 devstack sudo[97043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d
Sep 29 16:38:33 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:33 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" released by "_copy_volume_from_snapshot" :: held 11.229s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Acquiring lock "cinder-quobyte-f96876c7-0212-4462-8568-23cde2612e02" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-f96876c7-0212-4462-8568-23cde2612e02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Deleting offline snapshot f96876c7-0212-4462-8568-23cde2612e02 of volume c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] snapshot_file for this snap is: volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[473271dd-ca7e-459a-aa4a-397a73c18967]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:33 devstack sudo[97046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:33 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:34 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.398s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642bf27-823b-41c8-b32a-19d2a62565de]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:34 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:34 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.533s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:34 devstack sudo[97057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:34 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:35 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.360s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:35 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02
Sep 29 16:38:35 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:35 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465.f96876c7-0212-4462-8568-23cde2612e02" returned: 0 in 0.266s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-f96876c7-0212-4462-8568-23cde2612e02" released by "_delete_snapshot" :: held 1.676s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.398s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.742s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-866682202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec19e3-cdf1-4661-a47c-c49f456d91dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1444ab7d7134285961c8f67b3061022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:32Z,use_quota=True,user_id='4fccdb3745de4fee8e2d546b37a6752b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Creating volume 31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:38:35 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:38:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd 2147483648 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:35 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd 2147483648
Sep 29 16:38:35 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ceff9385-fd91-4691-b04c-f3954851931f tempest-GroupsV314Test-1137772429 None] Create group from source-group-b0111e34-cbc4-496f-b500-9b6cd3f4efed completed successfully.
Sep 29 16:38:36 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd 2147483648" returned: 0 in 0.529s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:36 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd
Sep 29 16:38:36 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:36 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd" returned: 0 in 0.326s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.124s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1872575041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d12038-a23f-4003-b072-66be301323ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:33Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Creating volume 04d12038-a23f-4003-b072-66be301323ad {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:38:36 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbda4ad-5124-48c4-8dd8-cde66e801fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd', 'volume_size': 2}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c547e3-7414-4616-ad95-d164aaac7f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:36 devstack sudo[97073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad 1073741824
Sep 29 16:38:36 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:36 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Volume volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd (31ec19e3-cdf1-4661-a47c-c49f456d91dd): created successfully
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c547e3-7414-4616-ad95-d164aaac7f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Flow 'volume_create_manager' (8f89e614-fb4f-4800-9acf-15cc09118547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:36 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2e13d65d-8ddd-46fa-8331-0740a534bd54 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Created volume successfully.
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Acquiring lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b3c85b-200b-4b82-9980-5795fe9bd4a3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:36 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d
Sep 29 16:38:36 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:37 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad 1073741824" returned: 0 in 0.647s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:37 devstack sudo[97083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad
Sep 29 16:38:37 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:37 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" returned: 0 in 0.521s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:37 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d
Sep 29 16:38:37 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:37 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.414s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c2922f-0cfe-446a-adec-7c44c985ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d12038-a23f-4003-b072-66be301323ad', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2252aa-bd66-463c-96f8-f0dfcbb4ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Creating offline snapshot e1743ebe-9af7-48e2-8922-d32afcb2a0f1 of volume 31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:38:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Volume volume-04d12038-a23f-4003-b072-66be301323ad (04d12038-a23f-4003-b072-66be301323ad): created successfully
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2252aa-bd66-463c-96f8-f0dfcbb4ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (e07b223a-b48f-46d1-a092-e67af9553528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[005797a5-2bdf-4e25-bf07-ac19a58517e0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:37 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-90916b60-3027-4ba3-9ff8-2780f4cfedf7 tempest-AttachVolumeNegativeTest-1073949744 None] Created volume successfully.
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-9b4aaa04-f7a7-4bb7-a900-e151ef12f84d" released by "delete_volume" :: held 0.876s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Created reservations ['98055783-51c4-44b0-ac2a-1d501cd5bd5d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:37 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd
Sep 29 16:38:37 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:37 devstack cinder-volume[86843]: WARNING cinder.quota [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1149442275 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1149442275, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:38:37 devstack cinder-volume[86843]: WARNING cinder.quota [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1149442275 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1149442275, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Created reservations ['bb7bbc33-6a5f-47cf-9a9b-8158640fcdc6', 'a70ec65f-7d28-4cc2-b120-7d51b8507db3', '28ced0f6-507f-4176-b8b7-cb0f67f34b8b', 'c1dfc62f-005b-4062-bbaa-d031cb108451'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:37 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:37 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:38 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd" returned: 0 in 0.593s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 2G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:38 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 2G
Sep 29 16:38:38 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:38 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bde35fd1-1636-45d4-8d0d-cf1c185aa96a tempest-GroupsV314Test-1137772429 None] Delete group completed successfully.
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Acquiring lock "cinder-quobyte-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b441799-1877-4353-ba51-abee21aee7fc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:38 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:38 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:38 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 2G" returned: 0 in 0.646s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:38 devstack sudo[97111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1
Sep 29 16:38:38 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.548s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:39 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465
Sep 29 16:38:39 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 is being set with open permissions: ugo+rw
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:39 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1
Sep 29 16:38:39 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Lock "cinder-quobyte-c56f0d8f-2f74-4e2e-8955-54bb13b5a465" released by "delete_volume" :: held 0.990s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-dfd0414f-2f4a-4cc9-9457-2582a64c4702 req-05d1e505-e884-4ef7-b17d-9bfd252fc47e tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Created reservations ['b19c7bbc-33d6-404c-9a6e-faa52eab4f0e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:39 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1" returned: 0 in 0.341s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:39 devstack sudo[97134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info
Sep 29 16:38:39 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Created reservations ['15222db5-10c5-4415-80d3-01b06ccc530a', '03ea80a0-c9b3-4653-86ac-e92c715c1e0c', '1238c2fd-1a40-4569-a851-5ca6a372b488', '88da33f0-6cdb-46c1-83ae-b6c44191f63b'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:39 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:39 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info" returned: 0 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info is being set with open permissions: ugo+rw
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:39 devstack sudo[97139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info
Sep 29 16:38:39 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:39 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.272s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:39 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bf6e37b5-7c3f-4160-b6f4-27f2187c4ead tempest-GroupsV314Test-1137772429 None] Delete group completed successfully.
Sep 29 16:38:40 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.info" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.833s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-dfd0414f-2f4a-4cc9-9457-2582a64c4702 req-05d1e505-e884-4ef7-b17d-9bfd252fc47e tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.761s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-dfd0414f-2f4a-4cc9-9457-2582a64c4702 req-05d1e505-e884-4ef7-b17d-9bfd252fc47e tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5d2e3b7f-e877-4a80-b790-ea7484b5643c tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Create snapshot completed successfully
Sep 29 16:38:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-dfd0414f-2f4a-4cc9-9457-2582a64c4702 req-05d1e505-e884-4ef7-b17d-9bfd252fc47e tempest-AttachVolumeNegativeTest-1073949744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-04d12038-a23f-4003-b072-66be301323ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56d28ab1-8292-4cca-bfa6-693d2b266cb1', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:38:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-dfd0414f-2f4a-4cc9-9457-2582a64c4702 req-05d1e505-e884-4ef7-b17d-9bfd252fc47e tempest-AttachVolumeNegativeTest-1073949744 None] attachment_update completed successfully.
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "cinder-e1743ebe-9af7-48e2-8922-d32afcb2a0f1-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-e1743ebe-9af7-48e2-8922-d32afcb2a0f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "cinder-quobyte-e1743ebe-9af7-48e2-8922-d32afcb2a0f1" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-e1743ebe-9af7-48e2-8922-d32afcb2a0f1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Deleting offline snapshot e1743ebe-9af7-48e2-8922-d32afcb2a0f1 of volume 31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] snapshot_file for this snap is: volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b86beb-dfb4-40d6-a368-e9fe26856e6c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:41 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1
Sep 29 16:38:41 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:42 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d2aac-d769-462b-800b-0fd274371766]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:42 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd
Sep 29 16:38:42 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:42 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd" returned: 0 in 0.532s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:42 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1
Sep 29 16:38:42 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:43 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1" returned: 0 in 0.501s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:43 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1
Sep 29 16:38:43 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:43 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd.e1743ebe-9af7-48e2-8922-d32afcb2a0f1" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-e1743ebe-9af7-48e2-8922-d32afcb2a0f1" released by "_delete_snapshot" :: held 2.022s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" released by "delete_snapshot" :: held 2.059s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Created reservations ['27f65723-112a-46f1-8a87-e38f9cbc717c', '114b1ada-46d0-47c4-9c46-f9c71310a50e', '8efe5e5f-7eae-4fa9-bfdd-753ab12480e2', '455b8c59-d53c-4f58-9bdc-684f2f2d4cd1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Delete snapshot completed successfully.
Sep 29 16:38:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-45aca7a0-7581-4f74-bba0-dca3e82e01aa req-c630a9c9-d09e-464d-a5c5-7dd4e7c39f23 tempest-AttachVolumeNegativeTest-1073949744 None] Terminate volume connection completed successfully.
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-45aca7a0-7581-4f74-bba0-dca3e82e01aa req-c630a9c9-d09e-464d-a5c5-7dd4e7c39f23 tempest-AttachVolumeNegativeTest-1073949744 None] Deleting attachment 56d28ab1-8292-4cca-bfa6-693d2b266cb1. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:38:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-283f095d-56c8-4019-b130-700178787776 tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-e1743ebe-9af7-48e2-8922-d32afcb2a0f1-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "cinder-31ec19e3-cdf1-4661-a47c-c49f456d91dd-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-31ec19e3-cdf1-4661-a47c-c49f456d91dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598a3d8-7600-4378-82a2-a116d2e5c8bc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:45 devstack sudo[97663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd
Sep 29 16:38:45 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:45 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd" returned: 0 in 0.585s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:45 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd
Sep 29 16:38:45 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:46 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-31ec19e3-cdf1-4661-a47c-c49f456d91dd" returned: 0 in 0.501s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-quobyte-31ec19e3-cdf1-4661-a47c-c49f456d91dd" released by "delete_volume" :: held 1.261s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Created reservations ['38a203d6-7d78-498a-acdd-c62b0ba63b19', '48bc7e0b-bda2-4541-8e5d-ab8624316801', '517fc2eb-72f6-4354-8448-a1d22601e642', '05d1c7ed-8b7d-4c9f-94e2-2f10695c1255'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:46 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:46 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:46 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.365s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Deleted volume successfully.
Sep 29 16:38:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-faa17999-a8e6-438d-8308-1f508c4a846a tempest-VolumesSnapshotNegativeTestJSON-24802350 None] Lock "cinder-31ec19e3-cdf1-4661-a47c-c49f456d91dd-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Flow 'volume_create_manager' (6094b280-b864-46a8-bd1d-8980ec6b5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e236cde7-abdb-4bae-85d2-ab84199afc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e236cde7-abdb-4bae-85d2-ab84199afc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-485278617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d37b1-96bd-4dcd-998a-6e7afb684f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fd68c53bdc48f6af0a83dcda817f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:48Z,use_quota=True,user_id='b3bf1374d3164fd895d88023103fce43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32329336-14e9-43fd-a78a-7a6d9de37e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32329336-14e9-43fd-a78a-7a6d9de37e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea383b29-bde4-435f-8ede-8add262f497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea383b29-bde4-435f-8ede-8add262f497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869d37b1-96bd-4dcd-998a-6e7afb684f16', 'volume_name': 'volume-869d37b1-96bd-4dcd-998a-6e7afb684f16', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecf1fa-f1e6-4cf4-8f31-aeefa7027a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ecf1fa-f1e6-4cf4-8f31-aeefa7027a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6ffec9-bc6a-4646-b483-863b18e7269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:48 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Volume 869d37b1-96bd-4dcd-998a-6e7afb684f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869d37b1-96bd-4dcd-998a-6e7afb684f16', 'volume_size': 1}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-485278617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d37b1-96bd-4dcd-998a-6e7afb684f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fd68c53bdc48f6af0a83dcda817f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:48Z,use_quota=True,user_id='b3bf1374d3164fd895d88023103fce43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Creating volume 869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:38:48 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:48 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 1073741824
Sep 29 16:38:48 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:48 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 1073741824" returned: 0 in 0.613s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:48 devstack sudo[97691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:38:48 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:49 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.350s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6ffec9-bc6a-4646-b483-863b18e7269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869d37b1-96bd-4dcd-998a-6e7afb684f16', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d92f42e-9de3-4165-8df1-a07e27d63764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Volume volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 (869d37b1-96bd-4dcd-998a-6e7afb684f16): created successfully
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d92f42e-9de3-4165-8df1-a07e27d63764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Flow 'volume_create_manager' (6094b280-b864-46a8-bd1d-8980ec6b5b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b6609f94-f066-449a-800d-b518e018bbb8 tempest-SnapshotDependencyTests-1182731941 None] Created volume successfully.
Sep 29 16:38:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac2b16af-ca59-45fa-947e-ed9a3d0aaf89 tempest-GroupsV320Test-824362206 None] Group tempest-GroupsV320Test-Group-892842987: creating
Sep 29 16:38:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac2b16af-ca59-45fa-947e-ed9a3d0aaf89 tempest-GroupsV320Test-824362206 None] Group tempest-GroupsV320Test-Group-892842987: created successfully
Sep 29 16:38:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac2b16af-ca59-45fa-947e-ed9a3d0aaf89 tempest-GroupsV320Test-824362206 None] Create group completed successfully.
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Creating offline snapshot fd171650-56f5-4b92-b1e4-fbf1854cd737 of volume 869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f71fb-6da8-4fdf-a224-887b58ffcce1]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:50 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:38:50 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:50 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:50 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 1G
Sep 29 16:38:50 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Created reservations ['0570c271-2255-449a-be1c-0fe464c61167'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:51 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:51 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:51 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 1G" returned: 0 in 0.640s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:51 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:38:51 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:51 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.362s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4765e5dc-b43f-414c-80a7-8dc60f5407ee tempest-GroupsV320Test-824362206 None] Delete group completed successfully.
Sep 29 16:38:51 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.364s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 is being set with open permissions: ugo+rw
Sep 29 16:38:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:51 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:38:51 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:52 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.252s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:52 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info
Sep 29 16:38:52 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:52 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:52 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info is being set with open permissions: ugo+rw
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:52 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info
Sep 29 16:38:52 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:52 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.info" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3b5d82d9-eca4-4d58-81e7-066bd1d326d5 tempest-SnapshotDependencyTests-1182731941 None] Create snapshot completed successfully
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:53 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:38:53 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:53 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:38:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Flow 'volume_create_manager' (d3391ef9-4deb-4c4d-af13-201655d4bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103164a0-ab59-4d64-8491-9b184287c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103164a0-ab59-4d64-8491-9b184287c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53117076-7206-4c76-b8f2-c6eba30b298c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fd68c53bdc48f6af0a83dcda817f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd171650-56f5-4b92-b1e4-fbf1854cd737,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:54Z,use_quota=True,user_id='b3bf1374d3164fd895d88023103fce43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f061ea12-c7bd-4978-87bc-eb3d254770c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f061ea12-c7bd-4978-87bc-eb3d254770c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38536016-b1c4-47fb-9171-4c8e33db6a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38536016-b1c4-47fb-9171-4c8e33db6a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53117076-7206-4c76-b8f2-c6eba30b298c', 'volume_name': 'volume-53117076-7206-4c76-b8f2-c6eba30b298c', 'volume_size': 1, 'snapshot_id': 'fd171650-56f5-4b92-b1e4-fbf1854cd737'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecb4d0c-09f6-41af-bcc8-cf625b33fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecb4d0c-09f6-41af-bcc8-cf625b33fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1a78c-bafc-4386-b25d-50abd3466c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:38:54 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Volume 53117076-7206-4c76-b8f2-c6eba30b298c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53117076-7206-4c76-b8f2-c6eba30b298c', 'volume_size': 1, 'snapshot_id': 'fd171650-56f5-4b92-b1e4-fbf1854cd737'}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737-53117076-7206-4c76-b8f2-c6eba30b298c" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737-53117076-7206-4c76-b8f2-c6eba30b298c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Creating volume 53117076-7206-4c76-b8f2-c6eba30b298c from snapshot fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] snapshot: fd171650-56f5-4b92-b1e4-fbf1854cd737, volume: 53117076-7206-4c76-b8f2-c6eba30b298c,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d67bd-285b-4e03-bef2-70fe9c4f255c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:55 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:38:55 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:55 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.546s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869d37b1-96bd-4dcd-998a-6e7afb684f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a67c92-d4c4-423a-8c1f-04bf6ef03d6b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:55 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:38:55 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:38:55 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:38:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:38:56 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c
Sep 29 16:38:56 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:04 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=63,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:39:04 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=52,cinder:UPDATE=64,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:39:05 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c" returned: 0 in 9.658s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:05 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16, size 1024.00 MB, duration 9.66 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:39:05 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Converted 1024.00 MB image at 106.01 MB/s
Sep 29 16:39:05 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c is being set with open permissions: ugo+rw
Sep 29 16:39:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:05 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c
Sep 29 16:39:05 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:06 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" released by "_copy_volume_from_snapshot" :: held 11.303s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737-53117076-7206-4c76-b8f2-c6eba30b298c" released by "_create_volume_from_snapshot" :: held 11.410s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.436s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f1a78c-bafc-4386-b25d-50abd3466c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53117076-7206-4c76-b8f2-c6eba30b298c', 'volume_size': 1, 'snapshot_id': 'fd171650-56f5-4b92-b1e4-fbf1854cd737'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76ec6d8-f3fb-417e-9fb2-2d66ad48d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Volume volume-53117076-7206-4c76-b8f2-c6eba30b298c (53117076-7206-4c76-b8f2-c6eba30b298c): created successfully
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76ec6d8-f3fb-417e-9fb2-2d66ad48d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Flow 'volume_create_manager' (d3391ef9-4deb-4c4d-af13-201655d4bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-19fef5f1-da98-47a0-ad72-bb99011c8a7c tempest-SnapshotDependencyTests-1182731941 None] Created volume successfully.
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-fd171650-56f5-4b92-b1e4-fbf1854cd737-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-fd171650-56f5-4b92-b1e4-fbf1854cd737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Deleting offline snapshot fd171650-56f5-4b92-b1e4-fbf1854cd737 of volume 869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] snapshot_file for this snap is: volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28c6ced-def0-4b2e-b9e1-e4038e05d3ca]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:07 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:39:07 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:08 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.816s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869d37b1-96bd-4dcd-998a-6e7afb684f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:39:08 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d53307a-2fff-428c-b4a6-380ebd38d653]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:08 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:39:08 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:09 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.804s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:09 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:39:09 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:09 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.512s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:09 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737
Sep 29 16:39:09 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:10 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16.fd171650-56f5-4b92-b1e4-fbf1854cd737" returned: 0 in 0.587s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-fd171650-56f5-4b92-b1e4-fbf1854cd737" released by "_delete_snapshot" :: held 3.024s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" released by "delete_snapshot" :: held 3.072s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:10 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Created reservations ['b48d19ac-07ff-4edb-92b7-8d6b2ceca10a', '3a61fa4e-235b-43b3-8859-465df8bfc845', '002ccca7-a42a-43c0-b8c1-753f8325ecbf', 'db9def64-d4c4-489b-bc90-63eb98b1bbf5'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Delete snapshot completed successfully.
Sep 29 16:39:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d09e8e9d-d517-460e-9619-c1fa96e17c76 tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-fd171650-56f5-4b92-b1e4-fbf1854cd737-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-869d37b1-96bd-4dcd-998a-6e7afb684f16-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-869d37b1-96bd-4dcd-998a-6e7afb684f16-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2caca0-be8a-466c-a07a-d96cebef6c0a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:11 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:39:11 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:12 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.606s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:12 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16
Sep 29 16:39:12 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:12 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-869d37b1-96bd-4dcd-998a-6e7afb684f16" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-869d37b1-96bd-4dcd-998a-6e7afb684f16" released by "delete_volume" :: held 1.210s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:12 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Created reservations ['52b0eb46-e29e-4f62-b038-f6af2187addf', '28c249e5-9488-4013-9ba9-51ca147f501c', '1b8ef309-9bbb-4db0-b306-535b180d7101', '4ff8ae5b-2a0e-4333-bf5a-aa82a9d22fd8'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:13 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:13 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:13 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:13 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Deleted volume successfully.
Sep 29 16:39:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cd4bba9c-e1ab-4382-ac13-63c57a20acbf tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-869d37b1-96bd-4dcd-998a-6e7afb684f16-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-53117076-7206-4c76-b8f2-c6eba30b298c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-53117076-7206-4c76-b8f2-c6eba30b298c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" acquired by "delete_volume" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2c91af-dc82-431d-97c2-e3c1f66c7ce1]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:14 devstack sudo[97901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c
Sep 29 16:39:14 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:15 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c" returned: 0 in 0.829s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:15 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c
Sep 29 16:39:15 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:15 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-53117076-7206-4c76-b8f2-c6eba30b298c" returned: 0 in 0.409s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-quobyte-53117076-7206-4c76-b8f2-c6eba30b298c" released by "delete_volume" :: held 1.349s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Created reservations ['bf73d06e-39e0-49ed-915a-1be60dc40391', '8bd7a6e7-44eb-4bbd-b0fa-269314bcacf3', '94dfcd57-acdd-45c0-b66b-0fda1149dc39', 'fff7538c-fe6c-4eaf-a3fe-08acdde52cd6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:15 devstack sudo[97909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:15 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:16 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.488s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:16 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Deleted volume successfully.
Sep 29 16:39:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ae9c9ce5-2823-4a87-a4fb-eee5974f569d tempest-SnapshotDependencyTests-1182731941 None] Lock "cinder-53117076-7206-4c76-b8f2-c6eba30b298c-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=6 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:39:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=29,cinder:INSERT=7,cinder:SELECT=14,cinder:DELETE=2 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (9d79fa8f-0bf0-42a6-8294-cb64ce6d67e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b293c-54aa-454e-aecd-e94765eef12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b293c-54aa-454e-aecd-e94765eef12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-6012694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b58460d-6de2-40cd-afa9-aac478760a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:36Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c24c6c5-2d83-4def-86c2-4ec8b6e7f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c24c6c5-2d83-4def-86c2-4ec8b6e7f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109de850-3f2e-40c7-a075-73ee00b8f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109de850-3f2e-40c7-a075-73ee00b8f663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b58460d-6de2-40cd-afa9-aac478760a77', 'volume_name': 'volume-2b58460d-6de2-40cd-afa9-aac478760a77', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d211f48-a102-452c-89d3-8f808926b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d211f48-a102-452c-89d3-8f808926b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bf8a1-44b4-405f-98c1-a91cb52e0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:36 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Volume 2b58460d-6de2-40cd-afa9-aac478760a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b58460d-6de2-40cd-afa9-aac478760a77', 'volume_size': 1}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-6012694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b58460d-6de2-40cd-afa9-aac478760a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441a9813040d4363bfe049278554f5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:36Z,use_quota=True,user_id='df882b54ac2f4440b3c7e06c13c1ceec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Creating volume 2b58460d-6de2-40cd-afa9-aac478760a77 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:39:36 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:39:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:36 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 1073741824
Sep 29 16:39:36 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:37 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 1073741824" returned: 0 in 0.609s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:37 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77
Sep 29 16:39:37 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:37 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77" returned: 0 in 0.469s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bf8a1-44b4-405f-98c1-a91cb52e0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b58460d-6de2-40cd-afa9-aac478760a77', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71da352c-0810-44e2-93fe-66d2e9cb6b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Volume volume-2b58460d-6de2-40cd-afa9-aac478760a77 (2b58460d-6de2-40cd-afa9-aac478760a77): created successfully
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71da352c-0810-44e2-93fe-66d2e9cb6b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Flow 'volume_create_manager' (9d79fa8f-0bf0-42a6-8294-cb64ce6d67e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-78ae655f-ce74-4c9f-badd-8342f7397065 tempest-AttachVolumeNegativeTest-1073949744 None] Created volume successfully.
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Flow 'volume_create_manager' (bac1df8b-d880-47dd-af47-700c051e11fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd84e43-b633-4b89-b32b-8ff01001d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd84e43-b633-4b89-b32b-8ff01001d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1436540519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fb939b-9d75-4f40-ae07-9b89e1508ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e1e11974f4de2ae8a2c81074d1a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:38Z,use_quota=True,user_id='36055fa5e8714972ae7e625ee975c2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ceaa99-e7d0-4eb5-a4a0-aa3d67332e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ceaa99-e7d0-4eb5-a4a0-aa3d67332e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0c702-d3f3-4034-b6b1-8421b38dca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0c702-d3f3-4034-b6b1-8421b38dca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fb939b-9d75-4f40-ae07-9b89e1508ddf', 'volume_name': 'volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7803f3-d130-4aea-9586-76bee410e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7803f3-d130-4aea-9586-76bee410e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fc6ae8-3da2-4251-a91c-997332a064cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Volume a8fb939b-9d75-4f40-ae07-9b89e1508ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf', 'volume_size': 1}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1436540519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fb939b-9d75-4f40-ae07-9b89e1508ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e1e11974f4de2ae8a2c81074d1a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:38Z,use_quota=True,user_id='36055fa5e8714972ae7e625ee975c2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Creating volume a8fb939b-9d75-4f40-ae07-9b89e1508ddf {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:39:38 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:38 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf 1073741824
Sep 29 16:39:38 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:38 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf 1073741824" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:38 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf
Sep 29 16:39:38 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:39 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" returned: 0 in 0.361s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fc6ae8-3da2-4251-a91c-997332a064cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29d4ec-69ec-413a-8c24-819045c128fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Volume volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf (a8fb939b-9d75-4f40-ae07-9b89e1508ddf): created successfully
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29d4ec-69ec-413a-8c24-819045c128fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Flow 'volume_create_manager' (bac1df8b-d880-47dd-af47-700c051e11fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c3757b62-4248-4493-8a6f-110c58f84f8a tempest-TestMinimumBasicScenario-481952097 None] Created volume successfully.
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e845ca39-bacf-4684-a554-4bedf360dd32 req-02f1a061-783d-4bb9-88b7-3b83ba82fa25 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e845ca39-bacf-4684-a554-4bedf360dd32 req-02f1a061-783d-4bb9-88b7-3b83ba82fa25 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e845ca39-bacf-4684-a554-4bedf360dd32 req-02f1a061-783d-4bb9-88b7-3b83ba82fa25 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-e845ca39-bacf-4684-a554-4bedf360dd32 req-02f1a061-783d-4bb9-88b7-3b83ba82fa25 tempest-AttachVolumeNegativeTest-1073949744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-2b58460d-6de2-40cd-afa9-aac478760a77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fca053d-8ace-4012-8e90-92a8de5898c3', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:39:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-e845ca39-bacf-4684-a554-4bedf360dd32 req-02f1a061-783d-4bb9-88b7-3b83ba82fa25 tempest-AttachVolumeNegativeTest-1073949744 None] attachment_update completed successfully.
Sep 29 16:39:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-29076a5a-e31d-4b50-8e58-ca5392ff2639 req-929bc85c-1744-4463-ab68-da1f23f01027 tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-29076a5a-e31d-4b50-8e58-ca5392ff2639 req-929bc85c-1744-4463-ab68-da1f23f01027 tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-29076a5a-e31d-4b50-8e58-ca5392ff2639 req-929bc85c-1744-4463-ab68-da1f23f01027 tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-29076a5a-e31d-4b50-8e58-ca5392ff2639 req-929bc85c-1744-4463-ab68-da1f23f01027 tempest-TestMinimumBasicScenario-481952097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0adfabe7-5a6e-4e08-abf7-307fbc7e3332', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:39:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-29076a5a-e31d-4b50-8e58-ca5392ff2639 req-929bc85c-1744-4463-ab68-da1f23f01027 tempest-TestMinimumBasicScenario-481952097 None] attachment_update completed successfully.
Sep 29 16:39:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-dab11879-1ad9-4ca2-a78b-62028589d781 req-570d4f43-af2c-487b-abfe-848bd0dbd92e tempest-AttachVolumeNegativeTest-1073949744 None] Terminate volume connection completed successfully.
Sep 29 16:39:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-dab11879-1ad9-4ca2-a78b-62028589d781 req-570d4f43-af2c-487b-abfe-848bd0dbd92e tempest-AttachVolumeNegativeTest-1073949744 None] Deleting attachment 5fca053d-8ace-4012-8e90-92a8de5898c3. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-2b58460d-6de2-40cd-afa9-aac478760a77-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-2b58460d-6de2-40cd-afa9-aac478760a77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-quobyte-2b58460d-6de2-40cd-afa9-aac478760a77" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-2b58460d-6de2-40cd-afa9-aac478760a77" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500ed70-adc3-4cf2-b629-0a8945b6f4cd]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:50 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77
Sep 29 16:39:50 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:50 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77" returned: 0 in 0.622s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:50 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77
Sep 29 16:39:50 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Flow 'volume_create_manager' (90e8a28d-1823-4107-aec9-16c31892b247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00baa232-301a-4386-8164-0cfdf5ff5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00baa232-301a-4386-8164-0cfdf5ff5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1992362360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43049ddf9cd34c33a60a28bf5bf4053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:51Z,use_quota=True,user_id='e618ea96af8647bca4a04ed75992bad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6de809f-6034-44bc-91a3-221710566e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6de809f-6034-44bc-91a3-221710566e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72506f1-eb6c-4a3b-bc56-c02d5aa4da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72506f1-eb6c-4a3b-bc56-c02d5aa4da41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b', 'volume_name': 'volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a0ef94-02d3-4a1a-aa5a-951c2170e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a0ef94-02d3-4a1a-aa5a-951c2170e706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155d0844-954a-48ea-9516-d617e32baf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:50 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b', 'volume_size': 1}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1992362360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43049ddf9cd34c33a60a28bf5bf4053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:51Z,use_quota=True,user_id='e618ea96af8647bca4a04ed75992bad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Creating volume ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:39:50 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:50 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2b58460d-6de2-40cd-afa9-aac478760a77" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:50 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b 1073741824
Sep 29 16:39:50 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-2b58460d-6de2-40cd-afa9-aac478760a77" released by "delete_volume" :: held 0.991s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:50 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Created reservations ['e6116c99-b048-4d80-be5e-5ebad4226469', '5e7a0921-b0c9-4b5e-8229-61dd145747b3', 'b106df06-a310-4869-957b-aa6cb6499c6e', 'e5642e95-4e9a-480a-99d9-b8002914cafc'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:51 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:51 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-04d12038-a23f-4003-b072-66be301323ad-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-04d12038-a23f-4003-b072-66be301323ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-quobyte-04d12038-a23f-4003-b072-66be301323ad" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-04d12038-a23f-4003-b072-66be301323ad" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:51 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.344s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Deleted volume successfully.
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1363a1dd-2c0f-45b5-b817-43546cbcccb3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-05ed103a-cd5b-47df-9cf8-578ff614f3d8 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-2b58460d-6de2-40cd-afa9-aac478760a77-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:51 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b 1073741824" returned: 0 in 0.651s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:51 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad
Sep 29 16:39:51 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:51 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b
Sep 29 16:39:51 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:51 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad" returned: 0 in 0.409s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:51 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" returned: 0 in 0.286s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:51 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad
Sep 29 16:39:51 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155d0844-954a-48ea-9516-d617e32baf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d613ce92-f30c-4b70-a2eb-be61d243e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:51 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b (ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b): created successfully
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d613ce92-f30c-4b70-a2eb-be61d243e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Flow 'volume_create_manager' (90e8a28d-1823-4107-aec9-16c31892b247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-add25533-5602-4ed4-935b-6a9a37fef33c tempest-VolumeQuotasAdminTestJSON-1633627025 None] Created volume successfully.
Sep 29 16:39:52 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-04d12038-a23f-4003-b072-66be301323ad" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-04d12038-a23f-4003-b072-66be301323ad" released by "delete_volume" :: held 0.724s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Created reservations ['bb0915e9-40d4-41dc-a693-a1d2dc0c2c4a', '24ecb0dc-a55a-4047-a7a5-550dc4bf1d21', 'd076774c-4778-4e58-a301-f49a59c83022', 'e8f91c34-12f9-473f-9a0c-b14d8815c7df'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:52 devstack sudo[98670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:52 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:52 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Deleted volume successfully.
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-20eeb73d-9696-4301-b7ba-94573d3c94a7 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-04d12038-a23f-4003-b072-66be301323ad-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-2d2b14ce-3bd5-4222-a64d-d6566db6736c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-2d2b14ce-3bd5-4222-a64d-d6566db6736c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "cinder-quobyte-2d2b14ce-3bd5-4222-a64d-d6566db6736c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-2d2b14ce-3bd5-4222-a64d-d6566db6736c" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d7dced-49c6-4065-a731-3381fc931676]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "cinder-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "cinder-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "cinder-quobyte-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:53 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c
Sep 29 16:39:53 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "cinder-quobyte-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5960b285-9730-4e03-935e-8065ea01a73c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b
Sep 29 16:39:53 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c
Sep 29 16:39:53 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" returned: 0 in 0.393s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b
Sep 29 16:39:53 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:53 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2d2b14ce-3bd5-4222-a64d-d6566db6736c" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-quobyte-2d2b14ce-3bd5-4222-a64d-d6566db6736c" released by "delete_volume" :: held 0.783s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Created reservations ['f9206168-1740-4e59-8246-fd48da6eea39', '8af282f8-7c6a-4abb-b094-c6a5c007cb0b', 'f466462e-2e48-4929-ab08-3eff2ef2abe9', '87db8657-308b-41f5-a5c0-ba39de5834a6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "cinder-quobyte-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b" released by "delete_volume" :: held 0.730s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:53 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:53 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:53 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Created reservations ['a4f9dc45-398e-43b6-9010-bff55444e439', '9cbaadd8-2a79-4da6-80d4-430560326d78', '8835c465-a1e0-4b83-8da4-60140ff84fa2', 'ed4ddd9c-d693-487b-904a-4f256f7930be'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:53 devstack sudo[98697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:53 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:54 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Deleted volume successfully.
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-151a03bb-e157-4034-852a-2f128f8260f2 tempest-AttachVolumeNegativeTest-1073949744 None] Lock "cinder-2d2b14ce-3bd5-4222-a64d-d6566db6736c-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:54 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.313s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Deleted volume successfully.
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e97de754-b342-426f-99ba-e42f43d26f20 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "cinder-ff3cb0a4-d74b-4ee4-a42a-0ffec5b7c75b-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Flow 'volume_create_manager' (4898565c-ec3e-4578-8ca9-997e09cee34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee83ae7-0782-4e77-bbd3-c3590200e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee83ae7-0782-4e77-bbd3-c3590200e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1670274019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50514d42-7206-4652-a98c-dc25e10e1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43049ddf9cd34c33a60a28bf5bf4053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:55Z,use_quota=True,user_id='e618ea96af8647bca4a04ed75992bad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84a09ca-a84b-4970-b5f7-c8d98a10c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84a09ca-a84b-4970-b5f7-c8d98a10c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed51023-8115-4b76-b81d-968ec4c179b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed51023-8115-4b76-b81d-968ec4c179b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50514d42-7206-4652-a98c-dc25e10e1a88', 'volume_name': 'volume-50514d42-7206-4652-a98c-dc25e10e1a88', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18946925-e3f4-4756-8482-69484abf705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18946925-e3f4-4756-8482-69484abf705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15061ca5-6a38-44a0-91cc-8cd1c452b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:54 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume 50514d42-7206-4652-a98c-dc25e10e1a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50514d42-7206-4652-a98c-dc25e10e1a88', 'volume_size': 1}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1670274019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50514d42-7206-4652-a98c-dc25e10e1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43049ddf9cd34c33a60a28bf5bf4053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:55Z,use_quota=True,user_id='e618ea96af8647bca4a04ed75992bad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Creating volume 50514d42-7206-4652-a98c-dc25e10e1a88 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:39:54 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:39:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:54 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 1073741824
Sep 29 16:39:54 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:55 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 1073741824" returned: 0 in 0.453s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:55 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88
Sep 29 16:39:55 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:55 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15061ca5-6a38-44a0-91cc-8cd1c452b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50514d42-7206-4652-a98c-dc25e10e1a88', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d668fc05-54b7-482e-aa80-8124e6f94f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:39:55 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Volume volume-50514d42-7206-4652-a98c-dc25e10e1a88 (50514d42-7206-4652-a98c-dc25e10e1a88): created successfully
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d668fc05-54b7-482e-aa80-8124e6f94f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:39:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Flow 'volume_create_manager' (4898565c-ec3e-4578-8ca9-997e09cee34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:39:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6da7c2ca-a640-4b6a-a551-adcdccbd9940 tempest-VolumeQuotasAdminTestJSON-1633627025 None] Created volume successfully.
Sep 29 16:39:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-081dff35-cd18-41c9-8482-a1ab9a0535c8 tempest-VolumeQuotasAdminTestJSON-461954688 None] Transfer volume completed successfully.
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Acquiring lock "cinder-50514d42-7206-4652-a98c-dc25e10e1a88-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "cinder-50514d42-7206-4652-a98c-dc25e10e1a88-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Acquiring lock "cinder-quobyte-50514d42-7206-4652-a98c-dc25e10e1a88" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "cinder-quobyte-50514d42-7206-4652-a98c-dc25e10e1a88" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff7d34-594b-48ec-8887-4bb25af12cc0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:58 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88
Sep 29 16:39:58 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:58 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:58 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88
Sep 29 16:39:58 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:58 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-50514d42-7206-4652-a98c-dc25e10e1a88" returned: 0 in 0.251s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "cinder-quobyte-50514d42-7206-4652-a98c-dc25e10e1a88" released by "delete_volume" :: held 0.719s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Created reservations ['ee8a7221-1578-4cd2-aae5-74b9d2caaa5d', 'a7781bf8-075a-424a-a506-e44b29bcd4f3', '1d19bdb3-77d7-4819-980e-2463da702c87', 'ec3c424a-aec5-4d95-8800-4c0be8ba996d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:39:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:39:58 devstack sudo[98721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:39:58 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:39:59 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root
Sep 29 16:39:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:39:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:39:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Deleted volume successfully.
Sep 29 16:39:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a693d67b-dc49-4ef0-b3a6-287d66576330 tempest-VolumeQuotasAdminTestJSON-1281084054 None] Lock "cinder-50514d42-7206-4652-a98c-dc25e10e1a88-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Flow 'volume_create_manager' (71762d22-649f-46f1-9752-349a87e1a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35f63f8-6359-4128-a57d-9040c47bab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35f63f8-6359-4128-a57d-9040c47bab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-944759992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1f1cb8-d094-4d35-bdbe-4a7bc310759c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe62064aca494ff3ac444d3d8f9817cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:03Z,use_quota=True,user_id='2ca7807db74e45ccb4a209433d006855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275cbe33-a3a1-4921-a8f2-b0f43af68bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275cbe33-a3a1-4921-a8f2-b0f43af68bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d06a54-b6ab-4742-811c-f65ce4adc401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d06a54-b6ab-4742-811c-f65ce4adc401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1f1cb8-d094-4d35-bdbe-4a7bc310759c', 'volume_name': 'volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8cdef-eb2a-4223-96a2-2232a993e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8cdef-eb2a-4223-96a2-2232a993e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa93751e-1d35-489d-a391-8cb7cc0ab52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Volume 1b1f1cb8-d094-4d35-bdbe-4a7bc310759c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c', 'volume_size': 1}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-944759992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1f1cb8-d094-4d35-bdbe-4a7bc310759c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe62064aca494ff3ac444d3d8f9817cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:03Z,use_quota=True,user_id='2ca7807db74e45ccb4a209433d006855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Creating volume 1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:40:02 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:40:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:02 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c 1073741824
Sep 29 16:40:02 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:03 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c 1073741824" returned: 0 in 0.540s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:03 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c
Sep 29 16:40:03 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:03 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa93751e-1d35-489d-a391-8cb7cc0ab52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f872ef7-1116-42b7-98b0-09312ac26c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Volume volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c (1b1f1cb8-d094-4d35-bdbe-4a7bc310759c): created successfully
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f872ef7-1116-42b7-98b0-09312ac26c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Flow 'volume_create_manager' (71762d22-649f-46f1-9752-349a87e1a738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-78f6bb29-8f7a-4bcc-9d71-0c51264dfa30 req-42459998-895d-402f-878d-24a379a30478 tempest-VolumesSnapshotsTestJSON-1738294916 None] Created volume successfully.
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Creating offline snapshot 441d5ff1-e14b-4625-96ba-538f96a3a144 of volume 1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa0fb6-c24d-41cc-bf94-cfa36744d8a0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:05 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c
Sep 29 16:40:05 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:05 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" returned: 0 in 0.545s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:05 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 1G
Sep 29 16:40:05 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:06 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 1G" returned: 0 in 0.611s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:06 devstack sudo[98823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144
Sep 29 16:40:06 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:06 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144" returned: 0 in 0.375s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:06 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 is being set with open permissions: ugo+rw
Sep 29 16:40:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:06 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144
Sep 29 16:40:06 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:06 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144" returned: 0 in 0.255s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:07 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info
Sep 29 16:40:07 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:07 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info" returned: 0 in 0.325s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:07 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info is being set with open permissions: ugo+rw
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:07 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info
Sep 29 16:40:07 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:07 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.info" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-291e79f5-8491-4839-b7ae-c6f1676ec1e2 req-fb4bd1ec-5df1-48e1-b140-7fbc5258caa2 tempest-VolumesSnapshotsTestJSON-1738294916 None] Create snapshot completed successfully
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Flow 'volume_create_manager' (2331c23e-36f6-4fa8-a259-135f37764246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025dadb0-6e7a-4859-8bc7-3fa1d6e37a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025dadb0-6e7a-4859-8bc7-3fa1d6e37a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1322528830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee24b4e2c87841829dfaa7a74e627a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:08Z,use_quota=True,user_id='3e7e298b2c194a04b17e2415c451ad93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90cd8e6-58f0-4195-911f-a1ea4dfaae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90cd8e6-58f0-4195-911f-a1ea4dfaae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a4dcee-b3ce-477d-a040-13615ad22883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a4dcee-b3ce-477d-a040-13615ad22883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0', 'volume_name': 'volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faed22c4-bb04-4a4f-8e69-ac7fbdd137db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faed22c4-bb04-4a4f-8e69-ac7fbdd137db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35231e3b-865f-461e-bfc5-39cb99e39add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Volume 9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0', 'volume_size': 1}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1322528830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee24b4e2c87841829dfaa7a74e627a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:08Z,use_quota=True,user_id='3e7e298b2c194a04b17e2415c451ad93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Creating volume 9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:40:08 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "cinder-441d5ff1-e14b-4625-96ba-538f96a3a144-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-441d5ff1-e14b-4625-96ba-538f96a3a144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:08 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 1073741824
Sep 29 16:40:08 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "cinder-quobyte-441d5ff1-e14b-4625-96ba-538f96a3a144" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-441d5ff1-e14b-4625-96ba-538f96a3a144" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Deleting offline snapshot 441d5ff1-e14b-4625-96ba-538f96a3a144 of volume 1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] snapshot_file for this snap is: volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2743532e-ae75-4ef3-9e4d-4ffc9da78356]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:08 devstack sudo[98841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144
Sep 29 16:40:08 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:08 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 1073741824" returned: 0 in 0.505s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:08 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0
Sep 29 16:40:08 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:08 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144" returned: 0 in 0.435s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da4f92-16f0-4459-b053-6bd67317dc14]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:09 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c
Sep 29 16:40:09 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:09 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" returned: 0 in 0.277s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35231e3b-865f-461e-bfc5-39cb99e39add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51718eeb-2c04-4a63-928b-3fbc5c8ed108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Volume volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 (9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0): created successfully
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51718eeb-2c04-4a63-928b-3fbc5c8ed108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Flow 'volume_create_manager' (2331c23e-36f6-4fa8-a259-135f37764246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d71a4159-4f3e-4e18-a79b-e2660a92e463 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Created volume successfully.
Sep 29 16:40:09 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:09 devstack sudo[98857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144
Sep 29 16:40:09 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:09 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144" returned: 0 in 0.318s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:09 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144
Sep 29 16:40:09 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:09 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c.441d5ff1-e14b-4625-96ba-538f96a3a144" returned: 0 in 0.239s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-441d5ff1-e14b-4625-96ba-538f96a3a144" released by "_delete_snapshot" :: held 1.525s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" released by "delete_snapshot" :: held 1.550s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.quota [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Created reservations ['6bb9245c-9bad-49fb-a56a-f7a813d0b67b', '98e48aa7-532e-4a53-af59-a4c78e5b4744', '92fee2ce-c054-4dcc-aa1e-d31c1d349af0', 'd861653d-3e94-404b-ae22-7fc664ea46e4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Delete snapshot completed successfully.
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-91f1182c-4504-4600-9464-531277139280 req-dbd0ae71-6085-4b23-9dbc-d78ea76bb088 tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-441d5ff1-e14b-4625-96ba-538f96a3a144-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Creating offline snapshot 94989cc7-d63a-4399-bc89-ed4d6b2c63d1 of volume 9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130baaf-24db-46aa-ab57-8a3c6ea924a6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "cinder-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:10 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0
Sep 29 16:40:10 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5b814-0cb7-4967-92e1-b6046bf9db2e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:10 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c
Sep 29 16:40:10 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:10 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:10 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 1G
Sep 29 16:40:10 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:11 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:11 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c
Sep 29 16:40:11 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:11 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 1G" returned: 0 in 0.421s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:11 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1
Sep 29 16:40:11 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:11 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-quobyte-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c" released by "delete_volume" :: held 0.799s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.quota [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Created reservations ['cb9f11d6-2774-453e-b54f-2403f7dc88ac', 'bfecad9d-0988-4166-92a1-69221f5d08a5', '8cdfcae6-41e4-4531-8f8d-693c4e925091', 'd5712248-2655-47f3-8981-38b7b992701c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:11 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:11 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:11 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 is being set with open permissions: ugo+rw
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:11 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1
Sep 29 16:40:11 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:11 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.manager [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Deleted volume successfully.
Sep 29 16:40:11 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-a5fccbd6-dc70-45c2-9713-d60b85b4913d req-48e2269f-7cfe-4bd8-9094-d5d860940e0d tempest-VolumesSnapshotsTestJSON-1738294916 None] Lock "cinder-1b1f1cb8-d094-4d35-bdbe-4a7bc310759c-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:12 devstack sudo[98898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info
Sep 29 16:40:12 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:12 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:12 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info is being set with open permissions: ugo+rw
Sep 29 16:40:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:12 devstack sudo[98901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info
Sep 29 16:40:12 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:12 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.info" returned: 0 in 0.270s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c704cc40-0221-475b-b84e-82a229986cf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Create snapshot completed successfully
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "cinder-94989cc7-d63a-4399-bc89-ed4d6b2c63d1-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-94989cc7-d63a-4399-bc89-ed4d6b2c63d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "cinder-quobyte-94989cc7-d63a-4399-bc89-ed4d6b2c63d1" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-94989cc7-d63a-4399-bc89-ed4d6b2c63d1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Deleting offline snapshot 94989cc7-d63a-4399-bc89-ed4d6b2c63d1 of volume 9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] snapshot_file for this snap is: volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6f46e-2c5b-4a07-84ce-c982dc3f565c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:14 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1
Sep 29 16:40:14 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:14 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1" returned: 0 in 0.403s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f364b36-fcad-46e9-a5f8-86097e831f14]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:14 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0
Sep 29 16:40:14 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:15 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:15 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1
Sep 29 16:40:15 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:15 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1" returned: 0 in 0.416s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:15 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1
Sep 29 16:40:15 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:15 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0.94989cc7-d63a-4399-bc89-ed4d6b2c63d1" returned: 0 in 0.264s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-94989cc7-d63a-4399-bc89-ed4d6b2c63d1" released by "_delete_snapshot" :: held 1.620s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" released by "delete_snapshot" :: held 1.649s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Created reservations ['b7cf017b-3e73-4950-93cc-c092eab6a63c', '35986925-cf97-468c-ac0e-3aa4a955fba6', '12e9dea8-ce70-403f-9467-0ce3f4a00816', '01ef19de-7df8-4ca3-a47d-934cdbf9c010'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Delete snapshot completed successfully.
Sep 29 16:40:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a798205-6645-48f4-b800-e7b3180eac9f tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-94989cc7-d63a-4399-bc89-ed4d6b2c63d1-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "cinder-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-655de512-4de3-4f65-8ea2-8b89934862d6 tempest-BackendsCapabilitiesAdminTestsJSON-1444734233 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86843) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-16e1a35f-ce5f-47e1-b4a1-8e38f3214764 tempest-BackendsCapabilitiesAdminTestsJSON-1444734233 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86843) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdbd92e-1c6e-4121-a6de-3456349b641f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:16 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0
Sep 29 16:40:16 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:17 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" returned: 0 in 0.453s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:17 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0
Sep 29 16:40:17 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:17 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-quobyte-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0" released by "delete_volume" :: held 0.816s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Created reservations ['365166fb-e4b3-4c3b-9fc6-9fa40e84a002', '5b0f994b-fbec-4db0-9d22-4406740be055', 'b8ba54d4-5dd0-4b03-97e0-0f359001c0f8', '91cbe590-9f24-4d03-abf2-7ca46d04c24b'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:17 devstack sudo[98934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:17 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:17 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.314s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Deleted volume successfully.
Sep 29 16:40:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a4612cf1-33a2-4b5c-ac5c-0a2f2c574255 tempest-VolumeSnapshotQuotasNegativeTestJSON-124062398 None] Lock "cinder-9cd9fa32-2dd1-4912-a55f-2cdc1373e9b0-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-930e4320-4d09-40b0-b82f-4578af040596 tempest-GroupSnapshotsV319Test-1210739998 None] Group tempest-GroupSnapshotsV319Test-Group-1241424053: creating
Sep 29 16:40:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-930e4320-4d09-40b0-b82f-4578af040596 tempest-GroupSnapshotsV319Test-1210739998 None] Group tempest-GroupSnapshotsV319Test-Group-1241424053: created successfully
Sep 29 16:40:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-930e4320-4d09-40b0-b82f-4578af040596 tempest-GroupSnapshotsV319Test-1210739998 None] Create group completed successfully.
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Flow 'volume_create_manager' (fbd031dd-5085-45a7-8ed3-7c9bb0d45f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324d187a-9242-4f0f-93d5-8de38ea00bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324d187a-9242-4f0f-93d5-8de38ea00bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474483254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=71d4b2d3-3e8e-470f-a62a-ad5e96016a9f,host='devstack@QuobyteHD#QuobyteHD',id=7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6733125bcf0241c8acf8b350f33709fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:25Z,use_quota=True,user_id='24fd2d116b394b7aa9a7f980dd7413e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0700f2b2-6703-400e-8bb5-e1ef2ffac9c3),volume_type_id=0700f2b2-6703-400e-8bb5-e1ef2ffac9c3)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24440fb-c58f-4220-84ea-f935c83e0cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24440fb-c58f-4220-84ea-f935c83e0cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7805a-7dbc-4ee9-800a-ae9d7cf448fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e7805a-7dbc-4ee9-800a-ae9d7cf448fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d', 'volume_name': 'volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d2ce6-e15a-4c17-9874-d29a1512106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d2ce6-e15a-4c17-9874-d29a1512106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edb5de1-2eb3-43aa-ab07-c6eedbd10d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:25 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Volume 7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d', 'volume_size': 1}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=71d4b2d3-3e8e-470f-a62a-ad5e96016a9f,created_at=2026-09-29T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474483254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=71d4b2d3-3e8e-470f-a62a-ad5e96016a9f,host='devstack@QuobyteHD#QuobyteHD',id=7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6733125bcf0241c8acf8b350f33709fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:25Z,use_quota=True,user_id='24fd2d116b394b7aa9a7f980dd7413e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0700f2b2-6703-400e-8bb5-e1ef2ffac9c3),volume_type_id=0700f2b2-6703-400e-8bb5-e1ef2ffac9c3)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Creating volume 7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:40:25 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:25 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d 1073741824
Sep 29 16:40:25 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:25 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d 1073741824" returned: 0 in 0.510s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:25 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d
Sep 29 16:40:25 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:25 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edb5de1-2eb3-43aa-ab07-c6eedbd10d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0532ade5-28b5-4fe8-be4b-01228cf3a088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Volume volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d (7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d): created successfully
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0532ade5-28b5-4fe8-be4b-01228cf3a088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Flow 'volume_create_manager' (fbd031dd-5085-45a7-8ed3-7c9bb0d45f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a49aab9b-be49-4b97-86d0-c86a796b7604 tempest-GroupSnapshotsV319Test-1210739998 None] Created volume successfully.
Sep 29 16:40:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] GroupSnapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: creating.
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Group snapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: creating. {{(pid=86843) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Creating offline snapshot 8efae450-068c-4e00-8d5c-db8bbac7d33a of volume 7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d96f1-cd0a-4a88-90ce-bee369bce902]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:26 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d
Sep 29 16:40:26 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:27 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" returned: 0 in 0.449s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:27 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a 1G
Sep 29 16:40:27 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:27 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a 1G" returned: 0 in 0.497s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:27 devstack sudo[98967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a
Sep 29 16:40:27 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:27 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a" returned: 0 in 0.303s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:27 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:40:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:28 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a
Sep 29 16:40:28 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:28 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:28 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info
Sep 29 16:40:28 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:28 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:28 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:28 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info
Sep 29 16:40:28 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:28 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.info" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-92561838-e5a4-40af-8262-9fc5a172909c tempest-GroupSnapshotsV319Test-1210739998 None] group_snapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: created successfully
Sep 29 16:40:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] group_snapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: deleting
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] group_snapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: deleting {{(pid=86843) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "cinder-quobyte-8efae450-068c-4e00-8d5c-db8bbac7d33a" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-8efae450-068c-4e00-8d5c-db8bbac7d33a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Deleting offline snapshot 8efae450-068c-4e00-8d5c-db8bbac7d33a of volume 7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] snapshot_file for this snap is: volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657681b-617b-4458-9791-4cb78605b9b9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:30 devstack sudo[98987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a
Sep 29 16:40:30 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:30 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc5a585-e764-45af-b902-5782f1d65625]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:31 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d
Sep 29 16:40:31 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:31 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:31 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a
Sep 29 16:40:31 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:31 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a" returned: 0 in 0.449s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:31 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a
Sep 29 16:40:31 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:32 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d.8efae450-068c-4e00-8d5c-db8bbac7d33a" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-8efae450-068c-4e00-8d5c-db8bbac7d33a" released by "_delete_snapshot" :: held 1.858s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" released by "delete_snapshot" :: held 1.889s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=4 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=97,cinder:SELECT=92,cinder:DELETE=12,cinder:INSERT=20 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:40:32 devstack cinder-volume[86843]: WARNING cinder.quota [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-971320197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-971320197, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:40:32 devstack cinder-volume[86843]: WARNING cinder.quota [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-971320197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-971320197, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] Created reservations ['b302fef0-126e-427e-8c1a-4321a18a37c6', 'a54dc931-4c82-4bbf-96e8-a99b42c33b38', '946c2abe-6898-4575-be40-d5344b1e8262', '90aab79c-7355-447e-a56f-e829adb21250'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1ac9b836-e0b9-4a71-8d08-cb323d2f7dd9 tempest-GroupSnapshotsV319Test-1210739998 None] group_snapshot ce51b511-3e57-46be-ba1d-b3dd1592f780: deleted successfully
Sep 29 16:40:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-094f4577-4632-4753-9dc5-420e63855bed req-7c81f580-5fc7-4642-ac74-0fc5cd744c0a tempest-TestMinimumBasicScenario-481952097 None] Terminate volume connection completed successfully.
Sep 29 16:40:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-094f4577-4632-4753-9dc5-420e63855bed req-7c81f580-5fc7-4642-ac74-0fc5cd744c0a tempest-TestMinimumBasicScenario-481952097 None] Deleting attachment 0adfabe7-5a6e-4e08-abf7-307fbc7e3332. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[536517ca-cc10-4892-a772-5d0dc03f83ad]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:33 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d
Sep 29 16:40:33 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "cinder-a8fb939b-9d75-4f40-ae07-9b89e1508ddf-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "cinder-a8fb939b-9d75-4f40-ae07-9b89e1508ddf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "cinder-quobyte-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "cinder-quobyte-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[553cbe16-2469-428b-aa2f-afca703a6e8b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:33 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" returned: 0 in 0.534s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:33 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d
Sep 29 16:40:33 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:33 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf
Sep 29 16:40:33 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:33 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "cinder-quobyte-7d4c6c7c-8c5f-4612-b2ba-21a56aab8f9d" released by "delete_volume" :: held 0.884s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Created reservations ['0acd6593-6983-4be1-bc47-654e7551533d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:34 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:34 devstack cinder-volume[86843]: WARNING cinder.quota [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-971320197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-971320197, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Created reservations ['154a74b7-77b7-41de-9f04-e8de85a55260', 'fa10d7e1-dbbc-4dd4-94ba-fa5a20d3a1ac', 'b4fda962-0916-4a28-9d04-cc9c98c2f494', '1f903f05-9e30-42bc-b3c3-b444f6899676'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:34 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf
Sep 29 16:40:34 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:34 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:34 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:34 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "cinder-quobyte-a8fb939b-9d75-4f40-ae07-9b89e1508ddf" released by "delete_volume" :: held 0.785s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Created reservations ['108dc6b3-41a3-4dce-9aaf-b674a95c0dbf', '25b73437-219f-43bc-858f-35df4ec4b45e', '44fccbe4-96b5-4476-9560-97716b67317f', '5b2d2dd1-b52e-4cb7-a529-510c9bb622d2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:34 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2e666917-2e12-4370-a411-2958a4f80063 tempest-GroupSnapshotsV319Test-1210739998 None] Delete group completed successfully.
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:34 devstack sudo[99036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:34 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:35 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.427s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:35 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Deleted volume successfully.
Sep 29 16:40:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3a1c3547-687a-4dc9-a4e1-49e971ca6915 tempest-TestMinimumBasicScenario-481952097 None] Lock "cinder-a8fb939b-9d75-4f40-ae07-9b89e1508ddf-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:44 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=22 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:40:45 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:INSERT=9,cinder:UPDATE=27,cinder:SELECT=17,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Flow 'volume_create_manager' (f7c5bf27-cceb-4d01-836b-63d3fd8d54f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49581bb9-7a3b-460f-8be0-c53550cf6fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49581bb9-7a3b-460f-8be0-c53550cf6fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-711394733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f27082-0b38-4288-837a-a2829a79931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4629956afe4126b76fe044541b0b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:47Z,use_quota=True,user_id='b7cd75fb51694f8c85cd9c24abc1d4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ea386a-46e9-467a-8f45-f17752e15a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ea386a-46e9-467a-8f45-f17752e15a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac795926-ab34-49c2-9616-5949ad99cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac795926-ab34-49c2-9616-5949ad99cf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f27082-0b38-4288-837a-a2829a79931e', 'volume_name': 'volume-02f27082-0b38-4288-837a-a2829a79931e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b6867a-745f-4e0c-9cbe-37c3b1cbae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b6867a-745f-4e0c-9cbe-37c3b1cbae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e617e-65ad-420e-9844-e75cd8ad3a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Volume 02f27082-0b38-4288-837a-a2829a79931e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f27082-0b38-4288-837a-a2829a79931e', 'volume_size': 1}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-711394733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f27082-0b38-4288-837a-a2829a79931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4629956afe4126b76fe044541b0b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:47Z,use_quota=True,user_id='b7cd75fb51694f8c85cd9c24abc1d4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Creating volume 02f27082-0b38-4288-837a-a2829a79931e {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:40:46 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:40:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:46 devstack sudo[99103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e 1073741824
Sep 29 16:40:46 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:47 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e 1073741824" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:47 devstack sudo[99109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e
Sep 29 16:40:47 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:47 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e" returned: 0 in 0.333s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99e617e-65ad-420e-9844-e75cd8ad3a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f27082-0b38-4288-837a-a2829a79931e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a7419f-0ce2-42ba-9cf4-6e59a91f3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:40:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Volume volume-02f27082-0b38-4288-837a-a2829a79931e (02f27082-0b38-4288-837a-a2829a79931e): created successfully
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a7419f-0ce2-42ba-9cf4-6e59a91f3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:40:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Flow 'volume_create_manager' (f7c5bf27-cceb-4d01-836b-63d3fd8d54f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:40:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-109761f7-dab9-49c5-89b8-8a333e7dfc35 tempest-VolumesServicesTestJSON-362314185 None] Created volume successfully.
Sep 29 16:40:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Acquiring lock "cinder-02f27082-0b38-4288-837a-a2829a79931e-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "cinder-02f27082-0b38-4288-837a-a2829a79931e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Acquiring lock "cinder-quobyte-02f27082-0b38-4288-837a-a2829a79931e" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "cinder-quobyte-02f27082-0b38-4288-837a-a2829a79931e" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[86874910-cad3-4bbe-b8bc-079eea5f2b03]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:49 devstack sudo[99113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e
Sep 29 16:40:49 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:49 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e" returned: 0 in 0.436s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:49 devstack sudo[99122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e
Sep 29 16:40:49 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:49 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-02f27082-0b38-4288-837a-a2829a79931e" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "cinder-quobyte-02f27082-0b38-4288-837a-a2829a79931e" released by "delete_volume" :: held 0.775s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Created reservations ['1c1ecdfb-bf0f-4ca2-af84-95b181b0b8aa', 'e3d88bbb-2d43-4939-81db-a208f283aea3', 'bf87d5f3-130b-479b-a0ad-7443cdfc5ea0', '53e1b42d-de30-4076-aa97-07ba081c63d1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:49 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:49 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:50 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.295s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:50 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Deleted volume successfully.
Sep 29 16:40:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d78a4965-e8c0-40b0-afdf-2327044ca6b7 tempest-VolumesServicesTestJSON-362314185 None] Lock "cinder-02f27082-0b38-4288-837a-a2829a79931e-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:40:53 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:40:53 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:40:53 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.361s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:40:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:40:59 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:41:00 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (71ee11e3-04bb-4258-b9a0-32292de2329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b361a-2986-4e2e-b8e7-73f859ee8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b361a-2986-4e2e-b8e7-73f859ee8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435828419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7f735d-77f1-4daf-b1a5-ce2f1f881574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217a587de9de429bb23cfa71f2a81987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:01Z,use_quota=True,user_id='d851b75ae0744c9e9fe302d1a138c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dfe6eb-28e3-4700-b548-70f26943af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dfe6eb-28e3-4700-b548-70f26943af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd70976f-6c70-4f6c-b49b-4028505739f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd70976f-6c70-4f6c-b49b-4028505739f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7f735d-77f1-4daf-b1a5-ce2f1f881574', 'volume_name': 'volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559aca09-ee6a-4795-9310-751508309634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559aca09-ee6a-4795-9310-751508309634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f467dfc-f202-4fb3-a86e-739e077c10fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Volume db7f735d-77f1-4daf-b1a5-ce2f1f881574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574', 'volume_size': 1}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435828419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7f735d-77f1-4daf-b1a5-ce2f1f881574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217a587de9de429bb23cfa71f2a81987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:01Z,use_quota=True,user_id='d851b75ae0744c9e9fe302d1a138c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Creating volume db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:01 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:01 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 1073741824
Sep 29 16:41:01 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:02 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 1073741824" returned: 0 in 0.666s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:02 devstack sudo[99244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:02 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:02 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f467dfc-f202-4fb3-a86e-739e077c10fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42124cb9-a424-4743-a3ac-597cfac2436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Volume volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 (db7f735d-77f1-4daf-b1a5-ce2f1f881574): created successfully
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42124cb9-a424-4743-a3ac-597cfac2436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (71ee11e3-04bb-4258-b9a0-32292de2329d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bcb2dc35-51eb-4d75-9477-d1746417ee07 tempest-VolumesDeleteCascade-601326809 None] Created volume successfully.
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (aeb7a62f-7462-4aa9-b652-3dd6cb6f7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e071db5-9af7-4518-8e53-f518953f9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e071db5-9af7-4518-8e53-f518953f9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1930831107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff11957-beb8-4e4e-bad2-5db3c02e19e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:03Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53485b7b-6175-4fc7-bc93-380603da1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53485b7b-6175-4fc7-bc93-380603da1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b439269-0c6d-4202-b8c2-0364d4e02ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b439269-0c6d-4202-b8c2-0364d4e02ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff11957-beb8-4e4e-bad2-5db3c02e19e2', 'volume_name': 'volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570cba5-a03e-4c32-a941-7659807de6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570cba5-a03e-4c32-a941-7659807de6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb59ea4e-67fd-42ac-af7f-3421f495abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Volume 8ff11957-beb8-4e4e-bad2-5db3c02e19e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2', 'volume_size': 1}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1930831107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff11957-beb8-4e4e-bad2-5db3c02e19e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:03Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Creating volume 8ff11957-beb8-4e4e-bad2-5db3c02e19e2 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:03 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:03 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 1073741824
Sep 29 16:41:03 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:04 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 1073741824" returned: 0 in 0.718s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:04 devstack sudo[99254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2
Sep 29 16:41:04 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:04 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.539s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb59ea4e-67fd-42ac-af7f-3421f495abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cddee6-7f16-406e-8400-fc8771425d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Creating offline snapshot 989e8185-a289-401f-8895-791aa08d395e of volume db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:41:04 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Volume volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 (8ff11957-beb8-4e4e-bad2-5db3c02e19e2): created successfully
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cddee6-7f16-406e-8400-fc8771425d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (aeb7a62f-7462-4aa9-b652-3dd6cb6f7a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b490ff-2c3d-4256-80eb-41197c799143]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-114210d7-41a6-4294-bcf5-31506ee3ce9f tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:04 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:04 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:05 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.567s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-17bdbff7-2e24-40e2-b4ea-832a4a94923b tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" by "attach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:05 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e 1G
Sep 29 16:41:05 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-17bdbff7-2e24-40e2-b4ea-832a4a94923b tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" acquired by "attach_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-17bdbff7-2e24-40e2-b4ea-832a4a94923b tempest-VolumesActionsTest-1374168286 None] Attaching volume 8ff11957-beb8-4e4e-bad2-5db3c02e19e2 to instance 6c1a8a88-4cdb-4a8d-bba4-858cacf79e3b at mountpoint /dev/vdb on host None.
Sep 29 16:41:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-17bdbff7-2e24-40e2-b4ea-832a4a94923b tempest-VolumesActionsTest-1374168286 None] Attach volume completed successfully.
Sep 29 16:41:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-17bdbff7-2e24-40e2-b4ea-832a4a94923b tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" released by "attach_volume" :: held 0.142s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:06 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e 1G" returned: 0 in 0.922s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:06 devstack sudo[99267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:06 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Terminate volume connection completed successfully.
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" by "detach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Detaching volume 8ff11957-beb8-4e4e-bad2-5db3c02e19e2 from instance 6c1a8a88-4cdb-4a8d-bba4-858cacf79e3b.
Sep 29 16:41:06 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.647s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:06 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e is being set with open permissions: ugo+rw
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:06 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:06 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Detach volume completed successfully.
Sep 29 16:41:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ebf6e16c-9235-41a0-8b02-4b702b4af515 tempest-VolumesActionsTest-1750151544 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:07 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d51e95c4-5ea2-45aa-a304-cd33d90056ab tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" by "detach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:07 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info
Sep 29 16:41:07 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d51e95c4-5ea2-45aa-a304-cd33d90056ab tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d51e95c4-5ea2-45aa-a304-cd33d90056ab tempest-VolumesActionsTest-1374168286 None] Volume detach called, but volume not attached.
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d51e95c4-5ea2-45aa-a304-cd33d90056ab tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:07 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info" returned: 0 in 0.460s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:07 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info is being set with open permissions: ugo+rw
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:07 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info
Sep 29 16:41:07 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-quobyte-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-quobyte-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c180b3-c2f3-477f-9c7d-216f5a62fcde]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:07 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2
Sep 29 16:41:07 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:08 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.info" returned: 0 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.540s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a0a69447-42ba-43c9-b280-db083f68324d tempest-VolumesDeleteCascade-601326809 None] Create snapshot completed successfully
Sep 29 16:41:08 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" returned: 0 in 0.515s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:08 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2
Sep 29 16:41:08 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:08 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Creating offline snapshot fb223d45-7612-4bd4-96b8-883cbb86b106 of volume db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386cd5a-1ce1-4c57-90ca-5c5079375442]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-quobyte-8ff11957-beb8-4e4e-bad2-5db3c02e19e2" released by "delete_volume" :: held 0.971s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Created reservations ['88a46462-bd39-4e15-843b-95f94162fd8a', '3cc7baee-6d87-4294-af3f-3342f70deec2', '590db3f7-20b0-475e-8823-978908e2bd66', '6ae713a6-117f-4c9a-be26-23b43a51b454'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:08 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:08 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:09 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:09 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:09 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.629s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:09 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 1G
Sep 29 16:41:09 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:09 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.589s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Deleted volume successfully.
Sep 29 16:41:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-47cf3a3a-87ce-49c2-a1ef-0b5caa052a76 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-8ff11957-beb8-4e4e-bad2-5db3c02e19e2-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:10 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 1G" returned: 0 in 0.773s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:10 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:10 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:10 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.424s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:10 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 is being set with open permissions: ugo+rw
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:10 devstack sudo[99313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:10 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:10 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.409s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bed7060f-b1e3-4f18-bcad-35a5e33564c0 tempest-VolumesDeleteCascade-601326809 None] Create snapshot completed successfully
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-db7f735d-77f1-4daf-b1a5-ce2f1f881574-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-db7f735d-77f1-4daf-b1a5-ce2f1f881574-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Performing cascade delete. {{(pid=86843) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-989e8185-a289-401f-8895-791aa08d395e-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-989e8185-a289-401f-8895-791aa08d395e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-989e8185-a289-401f-8895-791aa08d395e" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-989e8185-a289-401f-8895-791aa08d395e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Deleting offline snapshot 989e8185-a289-401f-8895-791aa08d395e of volume db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] snapshot_file for this snap is: volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[65447045-695d-45a6-85c4-e0a96f6c9e68]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:12 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:12 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:12 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.512s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422a5c1-1535-45e9-a8be-4362c3b15499]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:12 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:12 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:12 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed896b4-5f49-4ae7-bef7-ff2b9b5a38fd]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:13 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:13 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:13 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915ed8d-6965-4591-bd1a-5b56f8878bc3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:13 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:13 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (4d03f795-44aa-49f1-aa56-d5bc0cbd62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5c878c-9d79-412d-bb3f-6fd2234a679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5c878c-9d79-412d-bb3f-6fd2234a679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531508165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c7c765-696a-4269-94e3-826942aa8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:14Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243216eb-a9aa-496b-94ac-c9970ca1bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243216eb-a9aa-496b-94ac-c9970ca1bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7aa83bb-e104-4c13-8ba1-fc13ce230e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7aa83bb-e104-4c13-8ba1-fc13ce230e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c7c765-696a-4269-94e3-826942aa8c64', 'volume_name': 'volume-b7c7c765-696a-4269-94e3-826942aa8c64', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdfe60f-8a11-4540-baaa-6aacc42c19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdfe60f-8a11-4540-baaa-6aacc42c19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edab9d6-e971-4c1d-9ea7-8690ede5d033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:13 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Volume b7c7c765-696a-4269-94e3-826942aa8c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c7c765-696a-4269-94e3-826942aa8c64', 'volume_size': 1}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531508165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c7c765-696a-4269-94e3-826942aa8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:14Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Creating volume b7c7c765-696a-4269-94e3-826942aa8c64 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:13 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:13 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 1073741824
Sep 29 16:41:13 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:13 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.401s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b51eba-ba86-4f35-a14f-0053ee4892f3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:14 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:14 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:14 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 1073741824" returned: 0 in 0.517s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:14 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:14 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:14 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:14 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64
Sep 29 16:41:14 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:14 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edab9d6-e971-4c1d-9ea7-8690ede5d033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c7c765-696a-4269-94e3-826942aa8c64', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79044cb-e8c6-48d6-8369-85639f965c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Volume volume-b7c7c765-696a-4269-94e3-826942aa8c64 (b7c7c765-696a-4269-94e3-826942aa8c64): created successfully
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79044cb-e8c6-48d6-8369-85639f965c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (4d03f795-44aa-49f1-aa56-d5bc0cbd62f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:14 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.384s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0ca46c7c-eb38-4f9a-a205-07443cfd6b98 tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:14 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e
Sep 29 16:41:14 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:15 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.989e8185-a289-401f-8895-791aa08d395e" returned: 0 in 0.305s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 -F qcow2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:15 devstack sudo[99386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 -F qcow2
Sep 29 16:41:15 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:15 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 -F qcow2" returned: 0 in 0.304s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-989e8185-a289-401f-8895-791aa08d395e" released by "_delete_snapshot" :: held 3.386s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" released by "delete_snapshot" :: held 3.414s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Created reservations ['6a808c56-86bf-49cd-a36e-2e29d4a453f6', '3dd9c4a1-3847-4683-a107-375a37821f15', '2d0f2e59-1ce3-433a-92b2-ae30b20c2245', 'c1c99fe0-f711-4c23-97e5-586d5d71584c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Delete snapshot completed successfully.
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-989e8185-a289-401f-8895-791aa08d395e-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-fb223d45-7612-4bd4-96b8-883cbb86b106-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-fb223d45-7612-4bd4-96b8-883cbb86b106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-fb223d45-7612-4bd4-96b8-883cbb86b106" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-fb223d45-7612-4bd4-96b8-883cbb86b106" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Deleting offline snapshot fb223d45-7612-4bd4-96b8-883cbb86b106 of volume db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] snapshot_file for this snap is: volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14de1a-3e8b-49c5-a163-78221a3bc3fd]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:15 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:15 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-b7c7c765-696a-4269-94e3-826942aa8c64-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "cinder-b7c7c765-696a-4269-94e3-826942aa8c64-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-quobyte-b7c7c765-696a-4269-94e3-826942aa8c64" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:16 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-b7c7c765-696a-4269-94e3-826942aa8c64" acquired by "delete_volume" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.554s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ee4a50-5aa7-4c1a-9103-30b8911d240d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54eca87-2886-450a-b343-406e60195479]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:16 devstack sudo[99396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64
Sep 29 16:41:16 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:16 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:16 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:16 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64" returned: 0 in 0.455s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:16 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.431s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:16 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64
Sep 29 16:41:16 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:16 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:16 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:16 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b7c7c765-696a-4269-94e3-826942aa8c64" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-b7c7c765-696a-4269-94e3-826942aa8c64" released by "delete_volume" :: held 0.782s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Created reservations ['49b8e43c-a8c1-40df-8816-1db19f8b6f0f', '70607ac3-e807-4e5d-9ea4-e7fbf82315d7', '6218401b-3839-45d2-ae34-e8548ffea93a', '2c09e5b5-1af1-4496-a3f2-5a278cee43a1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:17 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.416s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:17 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:17 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:17 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106
Sep 29 16:41:17 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:17 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.319s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:17 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Deleted volume successfully.
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574.fb223d45-7612-4bd4-96b8-883cbb86b106" returned: 0 in 0.323s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-fb223d45-7612-4bd4-96b8-883cbb86b106" released by "_delete_snapshot" :: held 1.896s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f801b66-3bb7-40e5-aa78-0e91f465a99f tempest-VolumesActionsTest-1750151544 None] Lock "cinder-b7c7c765-696a-4269-94e3-826942aa8c64-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" released by "delete_snapshot" :: held 1.923s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Created reservations ['5e4af673-2cf2-4750-a5a6-60f2cbe2745e', '7458a470-0d3f-4fe8-b528-01a309c8020c', '04730ddd-c94b-45e6-89b1-1a16a4a2fe02', '936aa3d7-6261-4758-8f0e-3c4b725da186'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Delete snapshot completed successfully.
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-fb223d45-7612-4bd4-96b8-883cbb86b106-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Snapshots deleted, issuing volume delete {{(pid=86843) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02bacc5-92dd-4545-a72c-bc4a63802a1c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:17 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:17 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (77750ee8-c5f4-4f85-8627-959dbf12ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6b379-ad9c-49c7-863a-c0fde177c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6b379-ad9c-49c7-863a-c0fde177c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254832357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afb529-da1a-4429-978c-70955baf7294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:18Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd575b99-6c39-48b1-a739-7a6e3e7d8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd575b99-6c39-48b1-a739-7a6e3e7d8663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95991cf-6bad-4022-87b6-075b0065ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95991cf-6bad-4022-87b6-075b0065ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5afb529-da1a-4429-978c-70955baf7294', 'volume_name': 'volume-c5afb529-da1a-4429-978c-70955baf7294', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e3912b-3c2b-4b1a-b546-c209b0d9bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e3912b-3c2b-4b1a-b546-c209b0d9bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9a9cfe-5e93-430b-b9b9-d2517d783c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Volume c5afb529-da1a-4429-978c-70955baf7294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5afb529-da1a-4429-978c-70955baf7294', 'volume_size': 1}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254832357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afb529-da1a-4429-978c-70955baf7294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:18Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Creating volume c5afb529-da1a-4429-978c-70955baf7294 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:18 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:18 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 1073741824
Sep 29 16:41:18 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:18 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:18 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574
Sep 29 16:41:18 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:18 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-db7f735d-77f1-4daf-b1a5-ce2f1f881574" returned: 0 in 0.298s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-db7f735d-77f1-4daf-b1a5-ce2f1f881574" released by "delete_volume" :: held 0.846s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Created reservations ['842a73a5-68a7-410d-9250-f8a57ca3ad5b', '763d8882-4eee-470b-a1ef-44743de3feb4', '2f057711-8944-4e05-bef0-4dcc73f65410', '4a23e9e8-2629-45d1-85d9-7d1348610eeb'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:18 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 1073741824" returned: 0 in 0.618s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:18 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:18 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:18 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294
Sep 29 16:41:18 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:18 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Deleted volume successfully.
Sep 29 16:41:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-73681d20-0529-43fd-906f-d65845207f23 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-db7f735d-77f1-4daf-b1a5-ce2f1f881574-delete_volume" released by "delete_volume" :: held 7.123s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:19 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9a9cfe-5e93-430b-b9b9-d2517d783c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5afb529-da1a-4429-978c-70955baf7294', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c50ed43-72b0-4bc1-bcbe-633712a1d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:19 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Volume volume-c5afb529-da1a-4429-978c-70955baf7294 (c5afb529-da1a-4429-978c-70955baf7294): created successfully
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c50ed43-72b0-4bc1-bcbe-633712a1d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (77750ee8-c5f4-4f85-8627-959dbf12ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4baea947-7abc-47bb-bb56-4d334ee8e9d3 tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-c5afb529-da1a-4429-978c-70955baf7294-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "cinder-c5afb529-da1a-4429-978c-70955baf7294-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-quobyte-c5afb529-da1a-4429-978c-70955baf7294" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-c5afb529-da1a-4429-978c-70955baf7294" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[398acd03-3acf-43c0-aead-29868193d290]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:20 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294
Sep 29 16:41:20 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (40531cd4-661f-4c74-8029-4b3cdcc99469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8f4897-e978-4201-90a2-8696b9c8160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8f4897-e978-4201-90a2-8696b9c8160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1486728419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217a587de9de429bb23cfa71f2a81987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:21Z,use_quota=True,user_id='d851b75ae0744c9e9fe302d1a138c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e695985-baf0-47a9-8891-e34f3345008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e695985-baf0-47a9-8891-e34f3345008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af335e3e-986b-4473-a126-ff774a73f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af335e3e-986b-4473-a126-ff774a73f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b', 'volume_name': 'volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c37ed6-ca3e-4fa3-a4fa-f44b1e2e4ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c37ed6-ca3e-4fa3-a4fa-f44b1e2e4ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997efc73-5e31-489d-ab2f-8057eae2381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Volume c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b', 'volume_size': 1}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1486728419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217a587de9de429bb23cfa71f2a81987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:21Z,use_quota=True,user_id='d851b75ae0744c9e9fe302d1a138c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Creating volume c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:20 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:20 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b 1073741824
Sep 29 16:41:20 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:20 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294" returned: 0 in 0.434s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:20 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294
Sep 29 16:41:20 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:21 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c5afb529-da1a-4429-978c-70955baf7294" returned: 0 in 0.319s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-c5afb529-da1a-4429-978c-70955baf7294" released by "delete_volume" :: held 0.835s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:21 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b 1073741824" returned: 0 in 0.567s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Created reservations ['156286ae-8c83-42ff-8e8c-ed00dedeefa6', '34326b7c-85b1-4c26-9baa-42109313e743', '2626709f-9392-467e-9ff3-b52c7637792c', '9ce69728-a433-4ec5-83df-362e6bf29394'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:21 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:21 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:21 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:21 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:21 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:21 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Deleted volume successfully.
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997efc73-5e31-489d-ab2f-8057eae2381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0421ab3-e201-4688-97db-73d196904676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Volume volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b (c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b): created successfully
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0421ab3-e201-4688-97db-73d196904676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (40531cd4-661f-4c74-8029-4b3cdcc99469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b7a8dbff-fb94-40b5-bfd0-d386076433fb tempest-VolumesActionsTest-1750151544 None] Lock "cinder-c5afb529-da1a-4429-978c-70955baf7294-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-88bf6309-1618-42d3-be4f-92800a02bce7 tempest-VolumesDeleteCascade-601326809 None] Created volume successfully.
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (824c1aef-55f2-4a5a-8b2d-d1c5d25d8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f1fa0-343b-4d9e-be03-178c27103609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f1fa0-343b-4d9e-be03-178c27103609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-781918099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b3310f-8d61-4dbe-8a7a-d8a657af8d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:22Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7b126f-6600-4915-aa90-c62f9b114d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7b126f-6600-4915-aa90-c62f9b114d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509ea2e9-41cb-4df9-abdc-f4a44ac92bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509ea2e9-41cb-4df9-abdc-f4a44ac92bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b3310f-8d61-4dbe-8a7a-d8a657af8d8e', 'volume_name': 'volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85d67d-c47d-48fe-9c43-e892ce99bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85d67d-c47d-48fe-9c43-e892ce99bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5847b6ec-4fa3-456e-9bf3-53077d222363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:22 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Volume 64b3310f-8d61-4dbe-8a7a-d8a657af8d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e', 'volume_size': 1}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-781918099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b3310f-8d61-4dbe-8a7a-d8a657af8d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:22Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Creating volume 64b3310f-8d61-4dbe-8a7a-d8a657af8d8e {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:22 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:22 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e 1073741824
Sep 29 16:41:22 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:22 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e 1073741824" returned: 0 in 0.690s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:22 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e
Sep 29 16:41:22 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:23 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" returned: 0 in 0.288s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5847b6ec-4fa3-456e-9bf3-53077d222363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd867863-f16b-4806-82c3-fa201c0cec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Creating offline snapshot c8fc9549-0972-46fd-8c2b-c4ecf8fed71e of volume c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:41:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Volume volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e (64b3310f-8d61-4dbe-8a7a-d8a657af8d8e): created successfully
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd867863-f16b-4806-82c3-fa201c0cec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (824c1aef-55f2-4a5a-8b2d-d1c5d25d8702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debae01-d1d4-4443-95dd-aa703e79872e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac96803c-453a-4f0c-a62b-424193eeb557 tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:23 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:23 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:23 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:23 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e 1G
Sep 29 16:41:23 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:24 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e 1G" returned: 0 in 0.460s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:24 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:24 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "cinder-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-quobyte-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ea99f-d362-4e96-9bcf-1d37d24efc33]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:24 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.376s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:24 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e is being set with open permissions: ugo+rw
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:24 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:24 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:24 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e
Sep 29 16:41:24 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:24 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:24 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info
Sep 29 16:41:24 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:24 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" returned: 0 in 0.435s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:25 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e
Sep 29 16:41:25 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:25 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info" returned: 0 in 0.304s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:25 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info is being set with open permissions: ugo+rw
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:25 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:25 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info
Sep 29 16:41:25 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e" released by "delete_volume" :: held 0.805s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Created reservations ['fa1ff995-05c0-4b23-a5a7-37e5ed9d3cbc', '7a560c2b-9b8f-4181-9307-e4137c1be1c4', 'b0b198a2-c51e-4048-b8f1-6778c1c5ec68', '7c21b956-7186-46c2-ad76-5d79cf2a7472'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:25 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:25 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:25 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.info" returned: 0 in 0.328s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-37b63bde-238e-4d77-8b6d-825bc4e72299 tempest-VolumesDeleteCascade-601326809 None] Create snapshot completed successfully
Sep 29 16:41:25 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Deleted volume successfully.
Sep 29 16:41:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8679d638-2e2f-47a9-93aa-659767ec3b8e tempest-VolumesActionsTest-1750151544 None] Lock "cinder-64b3310f-8d61-4dbe-8a7a-d8a657af8d8e-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (d0ac215f-b04f-4c9a-97eb-8289a2cb0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dccb9e-5b53-483d-8c5f-d434ec45b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dccb9e-5b53-483d-8c5f-d434ec45b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173529296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a189242-07d1-41bc-a25e-98d3445676f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:26Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f45ba4-6498-4a92-89ec-4faaffdd05dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f45ba4-6498-4a92-89ec-4faaffdd05dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e009ea7-931a-47a6-a560-c4f5acd83eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e009ea7-931a-47a6-a560-c4f5acd83eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a189242-07d1-41bc-a25e-98d3445676f9', 'volume_name': 'volume-7a189242-07d1-41bc-a25e-98d3445676f9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67364b0-bb9c-4871-9974-e69a6c50c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67364b0-bb9c-4871-9974-e69a6c50c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00453cba-8f70-4348-9c4d-52ef93104a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Volume 7a189242-07d1-41bc-a25e-98d3445676f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a189242-07d1-41bc-a25e-98d3445676f9', 'volume_size': 1}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173529296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a189242-07d1-41bc-a25e-98d3445676f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:26Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Creating volume 7a189242-07d1-41bc-a25e-98d3445676f9 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:26 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:26 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 1073741824
Sep 29 16:41:26 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (55d1e24b-af13-404c-85f5-81ee9d7c1541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98bfc94-5a21-4c2f-a67b-ab2154207d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98bfc94-5a21-4c2f-a67b-ab2154207d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-324646390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837b1a4b-e230-4021-9565-163ea98bd657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217a587de9de429bb23cfa71f2a81987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8fc9549-0972-46fd-8c2b-c4ecf8fed71e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:27Z,use_quota=True,user_id='d851b75ae0744c9e9fe302d1a138c63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f066e03e-23f2-4411-b65e-3947465182ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f066e03e-23f2-4411-b65e-3947465182ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b925b27d-dd5d-45ad-ad89-0c851edf44a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b925b27d-dd5d-45ad-ad89-0c851edf44a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '837b1a4b-e230-4021-9565-163ea98bd657', 'volume_name': 'volume-837b1a4b-e230-4021-9565-163ea98bd657', 'volume_size': 1, 'snapshot_id': 'c8fc9549-0972-46fd-8c2b-c4ecf8fed71e'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3da2a7-3804-4e84-b44a-0bb64ccdae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3da2a7-3804-4e84-b44a-0bb64ccdae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6d08a1-5e85-4d84-9d2d-5f5b3eacd22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Volume 837b1a4b-e230-4021-9565-163ea98bd657: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-837b1a4b-e230-4021-9565-163ea98bd657', 'volume_size': 1, 'snapshot_id': 'c8fc9549-0972-46fd-8c2b-c4ecf8fed71e'}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:26 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 1073741824" returned: 0 in 0.550s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:26 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9
Sep 29 16:41:26 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:27 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.358s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-837b1a4b-e230-4021-9565-163ea98bd657" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00453cba-8f70-4348-9c4d-52ef93104a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a189242-07d1-41bc-a25e-98d3445676f9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da2d53-105a-4e57-84f3-4218afade35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-837b1a4b-e230-4021-9565-163ea98bd657" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Creating volume 837b1a4b-e230-4021-9565-163ea98bd657 from snapshot c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:27 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Volume volume-7a189242-07d1-41bc-a25e-98d3445676f9 (7a189242-07d1-41bc-a25e-98d3445676f9): created successfully
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da2d53-105a-4e57-84f3-4218afade35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (d0ac215f-b04f-4c9a-97eb-8289a2cb0636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] snapshot: c8fc9549-0972-46fd-8c2b-c4ecf8fed71e, volume: 837b1a4b-e230-4021-9565-163ea98bd657,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:41:27 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-efc9c4bd-2a1e-4435-bdc6-a2308165bf13 tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7201bc8a-86db-44cf-8d02-09e5b3186e9a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:27 devstack sudo[99517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:27 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:27 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.405s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf950b95-356d-4283-be9d-1ec38e1fcabf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Flow 'volume_create_manager' (582d81b4-91af-4051-8708-6ec4789c562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca10f62-e859-4925-9568-1f6813807d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca10f62-e859-4925-9568-1f6813807d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-493178577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d31e75b-753b-41b1-9843-fa05f32e6a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd034f9020848fcaae645d8fdefe6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:28Z,use_quota=True,user_id='22e09d38369542589082c34d8c30100b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580d4e7d-8035-4c97-99bd-556068b95823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580d4e7d-8035-4c97-99bd-556068b95823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be56eae2-9224-4818-86ab-cc7871d9cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:27 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:41:27 devstack sudo[99522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:27 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:28 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.390s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be56eae2-9224-4818-86ab-cc7871d9cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'volume_name': 'volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7f07f50>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3315a18e-4cec-411c-a809-b1aeeecc35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:28 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657
Sep 29 16:41:28 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3315a18e-4cec-411c-a809-b1aeeecc35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f74730-76f3-403b-bae0-07dc866185f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:28 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7f07f50>}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Trying to clone 4d31e75b-753b-41b1-9843-fa05f32e6a6a from image 5bde2f08-ba6c-4285-b385-cf604fce5707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-7a189242-07d1-41bc-a25e-98d3445676f9-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "cinder-7a189242-07d1-41bc-a25e-98d3445676f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Acquiring lock "cinder-quobyte-7a189242-07d1-41bc-a25e-98d3445676f9" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:41:28 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-7a189242-07d1-41bc-a25e-98d3445676f9" acquired by "delete_volume" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[79384259-dbb8-4034-a6a3-02d45c6b192f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[83385d8b-2412-4c28-b482-70b5f22a652e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:28 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9
Sep 29 16:41:28 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:28 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD
Sep 29 16:41:28 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:29 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9" returned: 0 in 0.557s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:29 devstack sudo[99547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9
Sep 29 16:41:29 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:29 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD" returned: 0 in 0.699s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 is fetched for user 22e09d38369542589082c34d8c30100b. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf6dc43-f8dc-49b9-bc1d-acbe2a3fbccc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:29 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a189242-07d1-41bc-a25e-98d3445676f9" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "cinder-quobyte-7a189242-07d1-41bc-a25e-98d3445676f9" released by "delete_volume" :: held 1.024s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:29 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD
Sep 29 16:41:29 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Created reservations ['8406fb90-9933-48ee-bb27-13fd8e40877d', 'ff4b4f46-3b81-408e-9179-0af69977d3ea', 'fadeb230-ed74-4a65-a123-076f5a3e3ed6', '00ff6eec-5120-49fe-8a89-efdc0788f0e1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:30 devstack sudo[99556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:30 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:30 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:30 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.510s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:30 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Deleted volume successfully.
Sep 29 16:41:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3dbcddca-345f-4ecb-812a-e033eb75f04b tempest-VolumesActionsTest-1750151544 None] Lock "cinder-7a189242-07d1-41bc-a25e-98d3445676f9-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (bbbe21b7-31b2-4326-b5c5-0eb2a776b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f30f67e-bf25-46c1-9396-501e6afd6591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f30f67e-bf25-46c1-9396-501e6afd6591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-82911064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571c54d5-107a-4cbf-9724-7ef6b28fd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:32Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08374a7-92ca-42a1-8409-62b20aae1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08374a7-92ca-42a1-8409-62b20aae1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e0e93-042d-4c2d-b1a9-cd2606764b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580e0e93-042d-4c2d-b1a9-cd2606764b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571c54d5-107a-4cbf-9724-7ef6b28fd851', 'volume_name': 'volume-571c54d5-107a-4cbf-9724-7ef6b28fd851', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505ef85b-3ce2-4a2c-a4a9-75cd2ffde4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505ef85b-3ce2-4a2c-a4a9-75cd2ffde4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b61a06-01a3-4042-99a2-5f0991435b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Volume 571c54d5-107a-4cbf-9724-7ef6b28fd851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571c54d5-107a-4cbf-9724-7ef6b28fd851', 'volume_size': 1}
Sep 29 16:41:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:35 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657" returned: 0 in 7.049s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:41:35 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Converted 1024.00 MB image at 145.24 MB/s
Sep 29 16:41:35 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 is being set with open permissions: ugo+rw
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:35 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657
Sep 29 16:41:35 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:35 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" released by "_copy_volume_from_snapshot" :: held 8.211s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-837b1a4b-e230-4021-9565-163ea98bd657" released by "_create_volume_from_snapshot" :: held 8.290s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.332s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.497s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-493178577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d31e75b-753b-41b1-9843-fa05f32e6a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd034f9020848fcaae645d8fdefe6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:28Z,use_quota=True,user_id='22e09d38369542589082c34d8c30100b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Creating volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:35 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:35 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1073741824
Sep 29 16:41:35 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6d08a1-5e85-4d84-9d2d-5f5b3eacd22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837b1a4b-e230-4021-9565-163ea98bd657', 'volume_size': 1, 'snapshot_id': 'c8fc9549-0972-46fd-8c2b-c4ecf8fed71e'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9267a9-cd71-49d8-a25f-370598a286e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Volume volume-837b1a4b-e230-4021-9565-163ea98bd657 (837b1a4b-e230-4021-9565-163ea98bd657): created successfully
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9267a9-cd71-49d8-a25f-370598a286e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Flow 'volume_create_manager' (55d1e24b-af13-404c-85f5-81ee9d7c1541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f1a5c705-0dc8-424a-aa63-c865015c343d tempest-VolumesDeleteCascade-601326809 None] Created volume successfully.
Sep 29 16:41:35 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1073741824" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack sudo[99572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a
Sep 29 16:41:36 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:36 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.422s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-82911064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571c54d5-107a-4cbf-9724-7ef6b28fd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c537f60324354b42a55279e2f9c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:32Z,use_quota=True,user_id='38124229c2684041a840d3c577c5506f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Creating volume 571c54d5-107a-4cbf-9724-7ef6b28fd851 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:36 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 1073741824
Sep 29 16:41:36 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Attempting download of 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a696b6f-3660-4b99-9063-e8e5052ddc05]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji
Sep 29 16:41:36 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Performing cascade delete. {{(pid=86843) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:36 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:36 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 1073741824" returned: 0 in 0.523s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Deleting offline snapshot c8fc9549-0972-46fd-8c2b-c4ecf8fed71e of volume c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] snapshot_file for this snap is: volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8be7cf-fe92-444f-828c-15d3eed84d33]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji
Sep 29 16:41:36 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:36 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851
Sep 29 16:41:36 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:36 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:36 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:37 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji" returned: 1 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_0txts3ji' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5b6b8-7d67-4ac1-a280-a6ac5127b7c0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:37 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b61a06-01a3-4042-99a2-5f0991435b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571c54d5-107a-4cbf-9724-7ef6b28fd851', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104c4745-e767-4bef-8377-355f232ea26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Volume volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 (571c54d5-107a-4cbf-9724-7ef6b28fd851): created successfully
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104c4745-e767-4bef-8377-355f232ea26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Flow 'volume_create_manager' (bbbe21b7-31b2-4326-b5c5-0eb2a776b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1e8a1bcf-4608-44dc-834b-58d30c25d863 tempest-VolumesActionsTest-1374168286 None] Created volume successfully.
Sep 29 16:41:37 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD
Sep 29 16:41:37 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:37 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.398s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee92f842-a5e4-4a0c-8d08-15b00325d507]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:37 devstack sudo[99600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:37 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:37 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] 5bde2f08-ba6c-4285-b385-cf604fce5707 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:37 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a
Sep 29 16:41:37 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:37 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.567s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:37 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:37 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:38 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.388s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:38 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e
Sep 29 16:41:38 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:38 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b.c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e" released by "_delete_snapshot" :: held 1.776s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" released by "delete_snapshot" :: held 1.807s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Created reservations ['12326f8b-11d3-4889-8388-bde9631ed19b', '26d2187a-0282-4e13-9b5c-cc31a0c565f2', 'f395272b-4dbd-4f29-9bfe-23406a22d99d', '34cfacb8-8dba-4fd3-9a0c-5324783acd62'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-571c54d5-107a-4cbf-9724-7ef6b28fd851-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Delete snapshot completed successfully.
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-c8fc9549-0972-46fd-8c2b-c4ecf8fed71e-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Snapshots deleted, issuing volume delete {{(pid=86843) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-571c54d5-107a-4cbf-9724-7ef6b28fd851-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" acquired by "delete_volume" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "cinder-quobyte-571c54d5-107a-4cbf-9724-7ef6b28fd851" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31963ed-76f1-49c4-ba43-4fdbf7aa01bf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-quobyte-571c54d5-107a-4cbf-9724-7ef6b28fd851" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c5a3d6-6385-4e3e-9077-1a7f9b8697d0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:39 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:39 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851
Sep 29 16:41:39 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:39 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b
Sep 29 16:41:39 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851" returned: 0 in 0.448s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:39 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851
Sep 29 16:41:39 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a" returned: 0 in 2.168s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_zwanzlb0devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:41:39 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Converted 112.00 MB image at 51.63 MB/s
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:39 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1G
Sep 29 16:41:39 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" returned: 0 in 0.300s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b" released by "delete_volume" :: held 0.873s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:39 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-571c54d5-107a-4cbf-9724-7ef6b28fd851" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-quobyte-571c54d5-107a-4cbf-9724-7ef6b28fd851" released by "delete_volume" :: held 0.833s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Created reservations ['2c4bdf38-9ddc-4af5-902b-64da2b34c777', '0405888c-104e-472a-905b-376c332a09a1', '99683172-efbd-4aa0-a83d-72136bc11c6a', '5e414454-6aaf-4cc5-a52f-01785631dbc4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Created reservations ['10858426-d216-40af-a705-e1f61a3e3fab', '84d34ec5-4941-481c-9b59-3a7f5639edfb', '40b00932-67cf-4af0-894c-fde3757ae8e3', 'c0e61f2b-3a5e-43a0-a802-124ae509e367'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:39 devstack sudo[99647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:39 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:40 devstack sudo[99650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:40 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:40 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a 1G" returned: 0 in 0.493s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Downloaded image 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 for user 22e09d38369542589082c34d8c30100b is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Marking volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Copying metadata from image 5bde2f08-ba6c-4285-b385-cf604fce5707 to 4d31e75b-753b-41b1-9843-fa05f32e6a6a. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Creating volume glance metadata for volume 4d31e75b-753b-41b1-9843-fa05f32e6a6a backed by image 5bde2f08-ba6c-4285-b385-cf604fce5707 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:41:40 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.321s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Deleted volume successfully.
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-837b1a4b-e230-4021-9565-163ea98bd657-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d7cc53e0-12ff-4d06-89c3-4956e8949ccc tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-c1f20fbe-db60-4ed7-834f-5d2d35ef9a6b-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-837b1a4b-e230-4021-9565-163ea98bd657-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f74730-76f3-403b-bae0-07dc866185f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7f07f50>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a0ce81-7b8d-417c-b4e2-f7d7ec95253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" acquired by "delete_volume" :: waited 0.047s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:40 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Volume volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a (4d31e75b-753b-41b1-9843-fa05f32e6a6a): created successfully
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a0ce81-7b8d-417c-b4e2-f7d7ec95253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Flow 'volume_create_manager' (582d81b4-91af-4051-8708-6ec4789c562e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[73654076-8ce5-43ea-83b6-e0ab26ea2e9a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:40 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.444s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c1d89930-894c-420e-ad73-0156ec2851f8 tempest-TestShelveInstance-1680077097 None] Created volume successfully.
Sep 29 16:41:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Deleted volume successfully.
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f6a499ab-d9fc-4dbf-9e07-aea1451bfad6 tempest-VolumesActionsTest-1374168286 None] Lock "cinder-571c54d5-107a-4cbf-9724-7ef6b28fd851-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:40 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657
Sep 29 16:41:40 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:40 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657" returned: 0 in 0.409s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:40 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657
Sep 29 16:41:40 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:41 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-837b1a4b-e230-4021-9565-163ea98bd657" returned: 0 in 0.285s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-quobyte-837b1a4b-e230-4021-9565-163ea98bd657" released by "delete_volume" :: held 0.754s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Created reservations ['d80d8b7c-041f-41e2-bbe4-efcec93c133a', '4388a0a6-0796-4831-9738-afeb09646589', '57358a3f-7ff3-42d2-97c4-6525a0e8171b', '23bdd10d-7c62-4200-ad2b-1a9b29db57a3'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:41 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:41 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:41 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.267s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Deleted volume successfully.
Sep 29 16:41:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e443f4a0-939a-4a19-976b-5c9d51e1c596 tempest-VolumesDeleteCascade-601326809 None] Lock "cinder-837b1a4b-e230-4021-9565-163ea98bd657-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-890eb0dc-1f30-4ae9-b667-446232798d14 req-3fca651a-9f50-4d7f-9ff9-51a5277ec6b0 tempest-TestShelveInstance-1680077097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-890eb0dc-1f30-4ae9-b667-446232798d14 req-3fca651a-9f50-4d7f-9ff9-51a5277ec6b0 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-890eb0dc-1f30-4ae9-b667-446232798d14 req-3fca651a-9f50-4d7f-9ff9-51a5277ec6b0 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-890eb0dc-1f30-4ae9-b667-446232798d14 req-3fca651a-9f50-4d7f-9ff9-51a5277ec6b0 tempest-TestShelveInstance-1680077097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd700c425-9b6d-44a0-8c35-8074c56156ba', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:41:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-890eb0dc-1f30-4ae9-b667-446232798d14 req-3fca651a-9f50-4d7f-9ff9-51a5277ec6b0 tempest-TestShelveInstance-1680077097 None] attachment_update completed successfully.
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Flow 'volume_create_manager' (8e53d1ad-97a6-487e-ac77-4e5fb0f3033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfda4de-0d7c-42fe-8494-845d1db21b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfda4de-0d7c-42fe-8494-845d1db21b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1630809279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f00f583-d85a-4321-930f-dbd08d510ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f68875fb8546f5914bbe0a3aadd4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:46Z,use_quota=True,user_id='b64ba18b897547d6b007ec097d9782c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beccbae-dfbb-448c-9595-28ab22e99fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beccbae-dfbb-448c-9595-28ab22e99fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891bdde9-e492-4e7b-96ce-43c5295a09ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891bdde9-e492-4e7b-96ce-43c5295a09ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f00f583-d85a-4321-930f-dbd08d510ad8', 'volume_name': 'volume-4f00f583-d85a-4321-930f-dbd08d510ad8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778996b9-9c25-4599-85a4-0f6ca61761e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778996b9-9c25-4599-85a4-0f6ca61761e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dc7301-838d-4563-b3db-5c98f1893703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Volume 4f00f583-d85a-4321-930f-dbd08d510ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f00f583-d85a-4321-930f-dbd08d510ad8', 'volume_size': 1}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1630809279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f00f583-d85a-4321-930f-dbd08d510ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f68875fb8546f5914bbe0a3aadd4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:46Z,use_quota=True,user_id='b64ba18b897547d6b007ec097d9782c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Creating volume 4f00f583-d85a-4321-930f-dbd08d510ad8 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:46 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:46 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 1073741824
Sep 29 16:41:46 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:47 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 1073741824" returned: 0 in 0.561s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:47 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8
Sep 29 16:41:47 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:47 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8" returned: 0 in 0.349s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4dc7301-838d-4563-b3db-5c98f1893703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f00f583-d85a-4321-930f-dbd08d510ad8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171ccdd1-b94c-4e2f-be32-aa652807a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Volume volume-4f00f583-d85a-4321-930f-dbd08d510ad8 (4f00f583-d85a-4321-930f-dbd08d510ad8): created successfully
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171ccdd1-b94c-4e2f-be32-aa652807a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Flow 'volume_create_manager' (8e53d1ad-97a6-487e-ac77-4e5fb0f3033f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-98702f4e-e65e-49da-b53e-67ad994ac373 tempest-VolumesMetadataTest-1521900847 None] Created volume successfully.
Sep 29 16:41:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Acquiring lock "cinder-4f00f583-d85a-4321-930f-dbd08d510ad8-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "cinder-4f00f583-d85a-4321-930f-dbd08d510ad8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Acquiring lock "cinder-quobyte-4f00f583-d85a-4321-930f-dbd08d510ad8" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "cinder-quobyte-4f00f583-d85a-4321-930f-dbd08d510ad8" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36aae47-be22-4ecb-afa5-c3fcf0a0da1c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:50 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8
Sep 29 16:41:50 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:50 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8" returned: 0 in 0.486s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:50 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8
Sep 29 16:41:50 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:50 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4f00f583-d85a-4321-930f-dbd08d510ad8" returned: 0 in 0.292s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "cinder-quobyte-4f00f583-d85a-4321-930f-dbd08d510ad8" released by "delete_volume" :: held 0.852s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:50 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Created reservations ['755e5e58-e149-45a2-a0dc-d428600779f0', '93d05109-bc9d-4180-91f1-adaf1f996e11', 'ed41a94c-aaac-4d1e-a9f5-be5de4320004', '3284d38b-a44b-47c9-9a52-c7cfc1b8e41e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:51 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:51 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:51 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Deleted volume successfully.
Sep 29 16:41:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8ea77ef9-894d-4e23-a5d6-4afe6a859a4b tempest-VolumesMetadataTest-1521900847 None] Lock "cinder-4f00f583-d85a-4321-930f-dbd08d510ad8-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:53 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:41:53 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:53 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:41:54 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:41:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:41:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (822408b7-d6c2-4209-abb8-207927ac7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad8f7ac-7bec-4a7e-a320-ec5039b4450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad8f7ac-7bec-4a7e-a320-ec5039b4450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-613485475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58188e81-e414-4c78-aa9e-4db95253d9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:59Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f947a1c-de35-453b-99fc-fccd4644a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f947a1c-de35-453b-99fc-fccd4644a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79bf31b-c819-49e4-8dd2-3aba46c3c7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79bf31b-c819-49e4-8dd2-3aba46c3c7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58188e81-e414-4c78-aa9e-4db95253d9cc', 'volume_name': 'volume-58188e81-e414-4c78-aa9e-4db95253d9cc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa62592d-780c-4543-9446-779a33a8b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa62592d-780c-4543-9446-779a33a8b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf3515a-3bb0-4172-af55-dc1dffacce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:58 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Volume 58188e81-e414-4c78-aa9e-4db95253d9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58188e81-e414-4c78-aa9e-4db95253d9cc', 'volume_size': 1}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-613485475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58188e81-e414-4c78-aa9e-4db95253d9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:59Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Creating volume 58188e81-e414-4c78-aa9e-4db95253d9cc {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:58 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:41:59 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc 1073741824
Sep 29 16:41:59 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Flow 'volume_create_manager' (0dc6be94-50d2-442c-8598-b090a32c5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c71670-defe-4db2-82a1-63d9a252eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c71670-defe-4db2-82a1-63d9a252eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042910763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ae871-321d-48db-b8d1-25850dc748c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb948381a1cd4ebda4dd3cd9edc8ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:59Z,use_quota=True,user_id='de01f9a16daa4d75b2cdd6ceb05ef405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b879527c-2fe2-4389-b591-44071903ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b879527c-2fe2-4389-b591-44071903ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5748e48-dcbd-474a-a558-975a7a52aead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5748e48-dcbd-474a-a558-975a7a52aead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697ae871-321d-48db-b8d1-25850dc748c5', 'volume_name': 'volume-697ae871-321d-48db-b8d1-25850dc748c5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38847b48-6a29-4809-aba2-48fbf55c7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38847b48-6a29-4809-aba2-48fbf55c7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341435cb-fae2-4232-ad34-b8f0960ab707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Volume 697ae871-321d-48db-b8d1-25850dc748c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697ae871-321d-48db-b8d1-25850dc748c5', 'volume_size': 1}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:59 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc 1073741824" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:59 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc
Sep 29 16:41:59 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:59 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042910763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ae871-321d-48db-b8d1-25850dc748c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb948381a1cd4ebda4dd3cd9edc8ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:59Z,use_quota=True,user_id='de01f9a16daa4d75b2cdd6ceb05ef405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Creating volume 697ae871-321d-48db-b8d1-25850dc748c5 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:41:59 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf3515a-3bb0-4172-af55-dc1dffacce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58188e81-e414-4c78-aa9e-4db95253d9cc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 1073741824
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234a439-10dc-4474-9dc8-bfc67fe2260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:41:59 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:41:59 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Volume volume-58188e81-e414-4c78-aa9e-4db95253d9cc (58188e81-e414-4c78-aa9e-4db95253d9cc): created successfully
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3234a439-10dc-4474-9dc8-bfc67fe2260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:41:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (822408b7-d6c2-4209-abb8-207927ac7d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:41:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8bb4c518-75d2-49dc-b153-2c4b9ff011a8 tempest-VolumesListAdminTestJSON-277090639 None] Created volume successfully.
Sep 29 16:42:00 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 1073741824" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=122,cinder:INSERT=34,cinder:UPDATE=140,cinder:DELETE=9 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:00 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5
Sep 29 16:42:00 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:00 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=151,cinder:SELECT=128,cinder:DELETE=16,cinder:INSERT=48 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341435cb-fae2-4232-ad34-b8f0960ab707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697ae871-321d-48db-b8d1-25850dc748c5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac82cd95-c669-4040-a643-3b5ac5874654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:00 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Volume volume-697ae871-321d-48db-b8d1-25850dc748c5 (697ae871-321d-48db-b8d1-25850dc748c5): created successfully
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac82cd95-c669-4040-a643-3b5ac5874654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Flow 'volume_create_manager' (0dc6be94-50d2-442c-8598-b090a32c5295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7cfbda51-a1e1-4819-8dfd-8c085147162c tempest-VolumesTransfersTest-1911534296 None] Created volume successfully.
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (30e4d6b3-0f28-47fc-9a66-66f67b57430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d79a37-3186-4613-938d-993df318a8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d79a37-3186-4613-938d-993df318a8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1873879780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fbdf76-5664-4809-b8b3-f372d6f0ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:01Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99477302-2761-407f-9d87-d95dfe330d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99477302-2761-407f-9d87-d95dfe330d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b65944-7475-4098-aaba-fc0281efa10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b65944-7475-4098-aaba-fc0281efa10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fbdf76-5664-4809-b8b3-f372d6f0ad7f', 'volume_name': 'volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc54c1b-16f2-405f-9ba1-47462816b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc54c1b-16f2-405f-9ba1-47462816b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c049f7f-ad50-440e-a0f6-ae91e20d5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Volume 10fbdf76-5664-4809-b8b3-f372d6f0ad7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f', 'volume_size': 1}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1873879780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fbdf76-5664-4809-b8b3-f372d6f0ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:01Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Creating volume 10fbdf76-5664-4809-b8b3-f372d6f0ad7f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:01 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:01 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f 1073741824
Sep 29 16:42:01 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-46fc1927-b98b-4076-9e5e-e837d1ae0d79 tempest-VolumesTransfersTest-1048314747 None] Transfer volume completed successfully.
Sep 29 16:42:02 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f 1073741824" returned: 0 in 0.506s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:02 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f
Sep 29 16:42:02 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "cinder-697ae871-321d-48db-b8d1-25850dc748c5-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-697ae871-321d-48db-b8d1-25850dc748c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "cinder-quobyte-697ae871-321d-48db-b8d1-25850dc748c5" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-quobyte-697ae871-321d-48db-b8d1-25850dc748c5" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af96ec4-735e-4ae6-916c-3711d40b2fe9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:02 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c049f7f-ad50-440e-a0f6-ae91e20d5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595807ab-787c-4c68-869f-d87058d4e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Volume volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f (10fbdf76-5664-4809-b8b3-f372d6f0ad7f): created successfully
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595807ab-787c-4c68-869f-d87058d4e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (30e4d6b3-0f28-47fc-9a66-66f67b57430e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4ab1f750-a118-45dc-8183-b0cbf7e8da71 tempest-VolumesListAdminTestJSON-277090639 None] Created volume successfully.
Sep 29 16:42:02 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5
Sep 29 16:42:02 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:02 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5" returned: 0 in 0.377s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:02 devstack sudo[100277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5
Sep 29 16:42:02 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:03 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-697ae871-321d-48db-b8d1-25850dc748c5" returned: 0 in 0.251s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-quobyte-697ae871-321d-48db-b8d1-25850dc748c5" released by "delete_volume" :: held 0.672s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Created reservations ['3d65b527-e282-4509-92cb-c822ce2e1f75', '3736b471-2cf3-45f6-92c9-cfbcd22e163b', '1ccdfc95-d36b-43db-a800-cda0b339771b', '13dac25a-360e-4ab1-a505-ef2c0cb99d51'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:03 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:03 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:03 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Deleted volume successfully.
Sep 29 16:42:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0b694b22-d91e-492b-96e7-ef8966d2b6f5 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-697ae871-321d-48db-b8d1-25850dc748c5-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Flow 'volume_create_manager' (bbfdb277-1b66-4718-9a8f-25e0f349de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33f0542-4b15-462f-815b-4dab25fd4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33f0542-4b15-462f-815b-4dab25fd4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1768316215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4205d72c-d3a6-425a-83e6-bca54849fdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb948381a1cd4ebda4dd3cd9edc8ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:04Z,use_quota=True,user_id='de01f9a16daa4d75b2cdd6ceb05ef405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c7e242-8060-4967-ae39-a56fb2ab5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c7e242-8060-4967-ae39-a56fb2ab5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1b907-21b0-4b61-a2ce-ca9581758cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc1b907-21b0-4b61-a2ce-ca9581758cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4205d72c-d3a6-425a-83e6-bca54849fdba', 'volume_name': 'volume-4205d72c-d3a6-425a-83e6-bca54849fdba', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfedf98-eae2-49a6-ae78-dd0ae5c4f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfedf98-eae2-49a6-ae78-dd0ae5c4f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7064f3-f9ef-40e0-81f7-32932d7c774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Volume 4205d72c-d3a6-425a-83e6-bca54849fdba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4205d72c-d3a6-425a-83e6-bca54849fdba', 'volume_size': 1}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1768316215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4205d72c-d3a6-425a-83e6-bca54849fdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb948381a1cd4ebda4dd3cd9edc8ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:04Z,use_quota=True,user_id='de01f9a16daa4d75b2cdd6ceb05ef405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Creating volume 4205d72c-d3a6-425a-83e6-bca54849fdba {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:04 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:04 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba 1073741824
Sep 29 16:42:04 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (b96cd28f-6d52-48bf-a427-a512a2c4bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2359fa54-2b6b-4fda-83bb-6f970a400e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2359fa54-2b6b-4fda-83bb-6f970a400e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249199734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3648f5c2-bb21-4476-9ccb-f7c3b1f91a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:04Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1f8ab3-ae99-48ae-a9e5-cd9176876ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1f8ab3-ae99-48ae-a9e5-cd9176876ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7405dc26-6e09-4978-a5e8-79641d55ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7405dc26-6e09-4978-a5e8-79641d55ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3648f5c2-bb21-4476-9ccb-f7c3b1f91a62', 'volume_name': 'volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fbebc3-d3b9-419c-a551-401b8026548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fbebc3-d3b9-419c-a551-401b8026548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3f0298-7c65-4e5a-b149-df31e6951d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:04 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Volume 3648f5c2-bb21-4476-9ccb-f7c3b1f91a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62', 'volume_size': 1}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:04 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba 1073741824" returned: 0 in 0.404s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:04 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba
Sep 29 16:42:04 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:05 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba" returned: 0 in 0.278s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249199734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3648f5c2-bb21-4476-9ccb-f7c3b1f91a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee7b195cc6e41918fd9a4a558638e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:04Z,use_quota=True,user_id='b937724ce76247778cddb2c03828f310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Creating volume 3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:05 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7064f3-f9ef-40e0-81f7-32932d7c774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4205d72c-d3a6-425a-83e6-bca54849fdba', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:05 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 1073741824
Sep 29 16:42:05 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5627cba-ab02-4ebe-9a26-354f5fe43bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:05 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Volume volume-4205d72c-d3a6-425a-83e6-bca54849fdba (4205d72c-d3a6-425a-83e6-bca54849fdba): created successfully
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5627cba-ab02-4ebe-9a26-354f5fe43bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Flow 'volume_create_manager' (bbfdb277-1b66-4718-9a8f-25e0f349de3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-93fd172e-01c0-42fd-9bf1-24335fdef417 tempest-VolumesTransfersTest-1911534296 None] Created volume successfully.
Sep 29 16:42:05 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 1073741824" returned: 0 in 0.428s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:05 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62
Sep 29 16:42:05 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:05 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" returned: 0 in 0.250s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3f0298-7c65-4e5a-b149-df31e6951d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebaf263-c79a-46f5-be74-5c06f96b65d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:05 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Volume volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 (3648f5c2-bb21-4476-9ccb-f7c3b1f91a62): created successfully
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebaf263-c79a-46f5-be74-5c06f96b65d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Flow 'volume_create_manager' (b96cd28f-6d52-48bf-a427-a512a2c4bd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0d89c097-6ee2-4ac5-9b64-11c60f1b2b44 tempest-VolumesListAdminTestJSON-277090639 None] Created volume successfully.
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "cinder-4205d72c-d3a6-425a-83e6-bca54849fdba-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-4205d72c-d3a6-425a-83e6-bca54849fdba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "cinder-quobyte-4205d72c-d3a6-425a-83e6-bca54849fdba" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-quobyte-4205d72c-d3a6-425a-83e6-bca54849fdba" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca520d-d1f3-44b9-bdbf-8fd4b8944bd6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:06 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba
Sep 29 16:42:06 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Flow 'volume_create_manager' (f8c11177-244a-4813-9d95-73a6a4229a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba46f27-1fbc-486c-bed0-b4b221f9c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:07 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba" returned: 0 in 0.442s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba46f27-1fbc-486c-bed0-b4b221f9c36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664950bc-5658-4563-b095-d848d0e19be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7c3ee72e9f41a1959eb1b2dd7cc0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:07Z,use_quota=True,user_id='ce8453b2627846d1b6cd502e86755bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5281d446-0190-494b-a051-158c094b34da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:07 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba
Sep 29 16:42:07 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5281d446-0190-494b-a051-158c094b34da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb3db46-de6e-42e5-9e1f-38dd2637aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb3db46-de6e-42e5-9e1f-38dd2637aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664950bc-5658-4563-b095-d848d0e19be5', 'volume_name': 'volume-664950bc-5658-4563-b095-d848d0e19be5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd2f56a-475c-471a-b731-0da3cb2d5506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd2f56a-475c-471a-b731-0da3cb2d5506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25f8f9-10df-4fd4-8b13-56a21a33d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:07 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Volume 664950bc-5658-4563-b095-d848d0e19be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664950bc-5658-4563-b095-d848d0e19be5', 'volume_size': 1}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664950bc-5658-4563-b095-d848d0e19be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7c3ee72e9f41a1959eb1b2dd7cc0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:07Z,use_quota=True,user_id='ce8453b2627846d1b6cd502e86755bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Creating volume 664950bc-5658-4563-b095-d848d0e19be5 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:07 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:07 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 1073741824
Sep 29 16:42:07 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:07 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4205d72c-d3a6-425a-83e6-bca54849fdba" returned: 0 in 0.309s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-quobyte-4205d72c-d3a6-425a-83e6-bca54849fdba" released by "delete_volume" :: held 0.815s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Created reservations ['fb5a20dc-fefb-4b03-be34-762302c4ddf2', '3bcbda04-8b4e-4c7c-9922-505ad592c879', '7c26b668-f11a-4478-8351-fb176c2e35cd', '3ece3812-16c0-439c-a4c5-283a7801c407'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:07 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:07 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:07 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 1073741824" returned: 0 in 0.587s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:07 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5
Sep 29 16:42:07 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:07 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.312s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Deleted volume successfully.
Sep 29 16:42:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-63ac4fa5-1846-499a-9229-d72a96e43473 tempest-VolumesTransfersTest-1532503550 None] Lock "cinder-4205d72c-d3a6-425a-83e6-bca54849fdba-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:08 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25f8f9-10df-4fd4-8b13-56a21a33d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664950bc-5658-4563-b095-d848d0e19be5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39b3a7d-0199-4ec5-8e85-2fe19009208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Volume volume-664950bc-5658-4563-b095-d848d0e19be5 (664950bc-5658-4563-b095-d848d0e19be5): created successfully
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39b3a7d-0199-4ec5-8e85-2fe19009208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Flow 'volume_create_manager' (f8c11177-244a-4813-9d95-73a6a4229a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-00f574e0-c059-4cd5-b9ca-0ec86320bdeb tempest-VolumesListAdminTestJSON-256315892 None] Created volume successfully.
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Acquiring lock "cinder-664950bc-5658-4563-b095-d848d0e19be5-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "cinder-664950bc-5658-4563-b095-d848d0e19be5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Acquiring lock "cinder-quobyte-664950bc-5658-4563-b095-d848d0e19be5" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "cinder-quobyte-664950bc-5658-4563-b095-d848d0e19be5" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f67bb-6158-4643-a5b2-98378c0fefec]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-quobyte-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ffb4cf-b86e-41c2-965c-54adf530cf3c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:09 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5
Sep 29 16:42:09 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:09 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62
Sep 29 16:42:09 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:10 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5" returned: 0 in 0.461s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:10 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5
Sep 29 16:42:10 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:10 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:10 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62
Sep 29 16:42:10 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:10 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-664950bc-5658-4563-b095-d848d0e19be5" returned: 0 in 0.301s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "cinder-quobyte-664950bc-5658-4563-b095-d848d0e19be5" released by "delete_volume" :: held 0.832s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Created reservations ['8fa31d3a-89d1-438d-9cc0-8d4e70b5d733', '8268fbe9-d25e-425b-b5a1-ebde120f0881', 'e4eac420-1992-4de7-9c73-0cdff67ef427', '86b71890-1072-4463-8c90-53a0844a23fc'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:10 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" returned: 0 in 0.316s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62" released by "delete_volume" :: held 0.791s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:10 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:10 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Created reservations ['c6752711-9f3c-42e8-abe3-a3044944b554', '44495005-baf0-4f50-b5c8-30b2299f2954', 'dbc99ee3-c574-414c-a165-77146ff5655f', 'efd580a9-9e70-4dc6-b8a9-f8ec73331c74'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:10 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:10 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:10 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.319s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:10 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Deleted volume successfully.
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-66ed272e-c691-494e-971c-018d257bbb31 tempest-VolumesListAdminTestJSON-256315892 None] Lock "cinder-664950bc-5658-4563-b095-d848d0e19be5-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-10fbdf76-5664-4809-b8b3-f372d6f0ad7f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-10fbdf76-5664-4809-b8b3-f372d6f0ad7f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:11 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-quobyte-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Deleted volume successfully.
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e3375882-3c7c-4e9b-b364-ad14c43b6fe5 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-3648f5c2-bb21-4476-9ccb-f7c3b1f91a62-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6444305-853e-47f0-8203-07d595ced1f4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:11 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f
Sep 29 16:42:11 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:11 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" returned: 0 in 0.422s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:11 devstack sudo[100384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f
Sep 29 16:42:11 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:11 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-10fbdf76-5664-4809-b8b3-f372d6f0ad7f" released by "delete_volume" :: held 0.740s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:11 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Created reservations ['430dcd1c-d7dd-4917-bd42-d00a021e0d4e', '9df2e615-0995-483b-8603-084bcbc23a6e', '27b4ae2e-4b08-4428-842c-6300780661ec', 'a55aedd5-943b-4345-bcb8-04261bd00957'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:12 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:12 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-58188e81-e414-4c78-aa9e-4db95253d9cc-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:12 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Deleted volume successfully.
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-58188e81-e414-4c78-aa9e-4db95253d9cc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48f86176-4bf5-4260-9e74-17cbe7bf324c tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-10fbdf76-5664-4809-b8b3-f372d6f0ad7f-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "cinder-quobyte-58188e81-e414-4c78-aa9e-4db95253d9cc" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-58188e81-e414-4c78-aa9e-4db95253d9cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f057a828-3d36-4812-b0bd-bf83e69f59d7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:12 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc
Sep 29 16:42:12 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:12 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:12 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc
Sep 29 16:42:12 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:13 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-58188e81-e414-4c78-aa9e-4db95253d9cc" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-quobyte-58188e81-e414-4c78-aa9e-4db95253d9cc" released by "delete_volume" :: held 0.715s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Created reservations ['e215e930-242a-499d-b328-e8c0ec8a3fea', '8ec7bb4f-930f-48cd-aea5-4b0c526f9b5c', 'd76fa0e3-cbb8-4ffe-9caa-47055427f400', '573c7792-6da7-4017-86a2-e9cdbfd4758c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:13 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:13 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:13 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:13 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Deleted volume successfully.
Sep 29 16:42:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-83b9122c-31f9-4ecf-9125-85f01e11d825 tempest-VolumesListAdminTestJSON-277090639 None] Lock "cinder-58188e81-e414-4c78-aa9e-4db95253d9cc-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Flow 'volume_create_manager' (d265cb53-da00-410f-b521-3702b65a4fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398e7b1-fb04-4ba7-9340-01f755046b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398e7b1-fb04-4ba7-9340-01f755046b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-921857668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd8059b-70cb-4e2d-a937-005be9cb6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f50778267145a89a73e085003ba573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:17Z,use_quota=True,user_id='c95171ac7a184647b7949f533b21a077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889da99e-71f7-4744-81c7-ef4fb1859701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889da99e-71f7-4744-81c7-ef4fb1859701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c9dd57-fed9-4326-9dc3-089e7ce08e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c9dd57-fed9-4326-9dc3-089e7ce08e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd8059b-70cb-4e2d-a937-005be9cb6336', 'volume_name': 'volume-7fd8059b-70cb-4e2d-a937-005be9cb6336', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444b3e2b-1495-4ee3-bafe-ac302dc9a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444b3e2b-1495-4ee3-bafe-ac302dc9a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6029f2af-c047-4fd3-b7e7-9f0796417ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Volume 7fd8059b-70cb-4e2d-a937-005be9cb6336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd8059b-70cb-4e2d-a937-005be9cb6336', 'volume_size': 1}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-921857668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd8059b-70cb-4e2d-a937-005be9cb6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f50778267145a89a73e085003ba573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:17Z,use_quota=True,user_id='c95171ac7a184647b7949f533b21a077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Creating volume 7fd8059b-70cb-4e2d-a937-005be9cb6336 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:16 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:16 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 1073741824
Sep 29 16:42:16 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:17 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 1073741824" returned: 0 in 0.586s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:17 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336
Sep 29 16:42:17 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:17 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336" returned: 0 in 0.321s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6029f2af-c047-4fd3-b7e7-9f0796417ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd8059b-70cb-4e2d-a937-005be9cb6336', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866bb8e7-8848-4f99-ae0c-aac11ce0c692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Volume volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 (7fd8059b-70cb-4e2d-a937-005be9cb6336): created successfully
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866bb8e7-8848-4f99-ae0c-aac11ce0c692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Flow 'volume_create_manager' (d265cb53-da00-410f-b521-3702b65a4fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-85002ed9-17b3-4f1f-9242-995c39f4fd2a tempest-VolumesTransfersV357Test-1665835754 None] Created volume successfully.
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Flow 'volume_create_manager' (76142dd0-950f-442b-8c2a-3a5f123b1b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa1e9e6-0e3a-43e4-8313-66d3a0eac4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa1e9e6-0e3a-43e4-8313-66d3a0eac4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-484352518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e838b1-63f3-4860-986c-ef252a485a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d995e1022d2421f84cad9f454d8243b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:20Z,use_quota=True,user_id='c19f09106eb24cc8930662a333c22979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5760b502-2a04-4a42-bad0-d6c3f471faa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5760b502-2a04-4a42-bad0-d6c3f471faa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3681b3a-87e0-4299-b48b-6fd4ad8b9c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:19 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:42:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d64080c1-833f-43fc-af66-0916bb7c117b tempest-VolumesTransfersV357Test-728025778 None] Transfer volume completed successfully.
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3681b3a-87e0-4299-b48b-6fd4ad8b9c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24e838b1-63f3-4860-986c-ef252a485a86', 'volume_name': 'volume-24e838b1-63f3-4860-986c-ef252a485a86', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda9bcb0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810083f7-3e9b-4dc8-8c3e-8ac7a1718561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810083f7-3e9b-4dc8-8c3e-8ac7a1718561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04d9987-a94e-4232-983e-8b480e2852ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Volume 24e838b1-63f3-4860-986c-ef252a485a86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24e838b1-63f3-4860-986c-ef252a485a86', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda9bcb0>}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Trying to clone 24e838b1-63f3-4860-986c-ef252a485a86 from image 5bde2f08-ba6c-4285-b385-cf604fce5707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:42:20 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "cinder-7fd8059b-70cb-4e2d-a937-005be9cb6336-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-7fd8059b-70cb-4e2d-a937-005be9cb6336-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb18eb7-7331-46ae-81af-a97b1432b319]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "cinder-quobyte-7fd8059b-70cb-4e2d-a937-005be9cb6336" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-quobyte-7fd8059b-70cb-4e2d-a937-005be9cb6336" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4126da-4824-4570-b4d0-f135b45e8676]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:20 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD
Sep 29 16:42:20 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:20 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336
Sep 29 16:42:20 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:20 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:20 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 is fetched for user c19f09106eb24cc8930662a333c22979. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac6fd0-b789-4322-9e5a-aa618c71f6f6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:21 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336" returned: 0 in 0.390s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:21 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336
Sep 29 16:42:21 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:21 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD
Sep 29 16:42:21 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:21 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7fd8059b-70cb-4e2d-a937-005be9cb6336" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-quobyte-7fd8059b-70cb-4e2d-a937-005be9cb6336" released by "delete_volume" :: held 0.708s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:21 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-484352518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e838b1-63f3-4860-986c-ef252a485a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d995e1022d2421f84cad9f454d8243b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:20Z,use_quota=True,user_id='c19f09106eb24cc8930662a333c22979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Creating volume 24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:21 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Created reservations ['511d6260-3c80-4727-8a5d-06408c05aa80', '16eba298-9aa3-4db4-99ab-f759a19ffe17', 'eb066e67-07b8-45dc-a290-4fdd471def7d', 'd52e4657-186b-4127-b9f0-906d0d9e4d00'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:21 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1073741824
Sep 29 16:42:21 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:21 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:21 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:21 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Deleted volume successfully.
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7df6dac7-3679-40d1-8a99-54e4481cdbb9 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-7fd8059b-70cb-4e2d-a937-005be9cb6336-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:21 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1073741824" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:21 devstack sudo[100451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86
Sep 29 16:42:21 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:22 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Attempting download of 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume 24e838b1-63f3-4860-986c-ef252a485a86. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Flow 'volume_create_manager' (3b88e249-f545-4eb1-abd2-010b2580ad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3cf0-a655-4a7b-814a-57a512dd5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3cf0-a655-4a7b-814a-57a512dd5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988551837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6cc3ec-caaa-466d-905b-d963162faacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f50778267145a89a73e085003ba573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:22Z,use_quota=True,user_id='c95171ac7a184647b7949f533b21a077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee987dd9-2f10-414f-aec4-d51f1f475184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee987dd9-2f10-414f-aec4-d51f1f475184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c594eb3d-29c5-41c8-8993-a2313b03eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c594eb3d-29c5-41c8-8993-a2313b03eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a6cc3ec-caaa-466d-905b-d963162faacc', 'volume_name': 'volume-2a6cc3ec-caaa-466d-905b-d963162faacc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a88940-a21d-4ed9-aeeb-a1c6329cfeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a88940-a21d-4ed9-aeeb-a1c6329cfeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdf751-4172-4b06-8ad7-e1606e59116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:22 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Volume 2a6cc3ec-caaa-466d-905b-d963162faacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a6cc3ec-caaa-466d-905b-d963162faacc', 'volume_size': 1}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988551837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6cc3ec-caaa-466d-905b-d963162faacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f50778267145a89a73e085003ba573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:22Z,use_quota=True,user_id='c95171ac7a184647b7949f533b21a077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Creating volume 2a6cc3ec-caaa-466d-905b-d963162faacc {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:22 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb959bdb-be16-40d1-a113-e4967f005b00]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:22 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc 1073741824
Sep 29 16:42:22 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:22 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4
Sep 29 16:42:22 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:22 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:22 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc 1073741824" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:22 devstack sudo[100463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4
Sep 29 16:42:22 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:22 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc
Sep 29 16:42:22 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:23 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4" returned: 1 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ou9mmas4' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[beabb88f-6a3a-4df1-a710-2ee0c3d2b59d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:23 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdf751-4172-4b06-8ad7-e1606e59116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6cc3ec-caaa-466d-905b-d963162faacc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68263f90-f9ce-4f27-a6d2-7e8a2a05bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Volume volume-2a6cc3ec-caaa-466d-905b-d963162faacc (2a6cc3ec-caaa-466d-905b-d963162faacc): created successfully
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68263f90-f9ce-4f27-a6d2-7e8a2a05bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Flow 'volume_create_manager' (3b88e249-f545-4eb1-abd2-010b2580ad18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c1195559-8dfc-4c5a-804c-0e89f59e7a67 tempest-VolumesTransfersV357Test-1665835754 None] Created volume successfully.
Sep 29 16:42:23 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD
Sep 29 16:42:23 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:23 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] 5bde2f08-ba6c-4285-b385-cf604fce5707 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:23 devstack sudo[100477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86
Sep 29 16:42:23 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "cinder-2a6cc3ec-caaa-466d-905b-d963162faacc-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-2a6cc3ec-caaa-466d-905b-d963162faacc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "cinder-quobyte-2a6cc3ec-caaa-466d-905b-d963162faacc" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-quobyte-2a6cc3ec-caaa-466d-905b-d963162faacc" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd1e6be-0911-4359-b692-d6e203b6c1f5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:23 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc
Sep 29 16:42:23 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:24 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:24 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc
Sep 29 16:42:24 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:24 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2a6cc3ec-caaa-466d-905b-d963162faacc" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-quobyte-2a6cc3ec-caaa-466d-905b-d963162faacc" released by "delete_volume" :: held 0.753s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Created reservations ['b847d61d-d719-4c63-838d-e8acf946a9b8', 'ce0df96b-e25f-4e62-91dc-7890863e0203', 'de9339e6-c9a2-437d-a5ee-542e41117a5f', 'a7d85c0d-5104-4bb6-9757-633b3e34edb1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:24 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:24 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:24 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.328s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Deleted volume successfully.
Sep 29 16:42:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7cd77e3a-53f2-403f-b291-9252eb49d4f0 tempest-VolumesTransfersV357Test-352468298 None] Lock "cinder-2a6cc3ec-caaa-466d-905b-d963162faacc-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:25 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86" returned: 0 in 2.136s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_qm2fzq71devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:42:25 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Converted 112.00 MB image at 52.42 MB/s
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:25 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1G
Sep 29 16:42:25 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:25 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 1G" returned: 0 in 0.346s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Downloaded image 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume 24e838b1-63f3-4860-986c-ef252a485a86 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 for user c19f09106eb24cc8930662a333c22979 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Marking volume 24e838b1-63f3-4860-986c-ef252a485a86 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Copying metadata from image 5bde2f08-ba6c-4285-b385-cf604fce5707 to 24e838b1-63f3-4860-986c-ef252a485a86. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:42:25 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Creating volume glance metadata for volume 24e838b1-63f3-4860-986c-ef252a485a86 backed by image 5bde2f08-ba6c-4285-b385-cf604fce5707 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:42:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04d9987-a94e-4232-983e-8b480e2852ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e838b1-63f3-4860-986c-ef252a485a86', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda9bcb0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7820df7d-b648-4666-af80-119825695beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Volume volume-24e838b1-63f3-4860-986c-ef252a485a86 (24e838b1-63f3-4860-986c-ef252a485a86): created successfully
Sep 29 16:42:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7820df7d-b648-4666-af80-119825695beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Flow 'volume_create_manager' (76142dd0-950f-442b-8c2a-3a5f123b1b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-321df7bc-3bfb-4e30-a898-802c98e46001 tempest-VolumesImageMetadata-478923483 None] Created volume successfully.
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Acquiring lock "cinder-24e838b1-63f3-4860-986c-ef252a485a86-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "cinder-24e838b1-63f3-4860-986c-ef252a485a86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Acquiring lock "cinder-quobyte-24e838b1-63f3-4860-986c-ef252a485a86" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "cinder-quobyte-24e838b1-63f3-4860-986c-ef252a485a86" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c93cb-997b-48d7-8bbb-d3795c8364cc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:28 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86
Sep 29 16:42:28 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:28 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86" returned: 0 in 0.401s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:28 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86
Sep 29 16:42:28 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:28 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-24e838b1-63f3-4860-986c-ef252a485a86" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "cinder-quobyte-24e838b1-63f3-4860-986c-ef252a485a86" released by "delete_volume" :: held 0.730s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Created reservations ['5bee6d1d-a5d8-4cae-8f76-500eb2eecff1', '1de32d33-5e21-46c1-9956-cf9c143009d5', 'e4a3f056-0fdb-4f28-9c3b-da68321429bc', '050f5faa-9086-439c-9f44-856de5199e5e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:28 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:28 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:29 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:29 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Deleted volume successfully.
Sep 29 16:42:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8a25d098-046c-4496-aae0-5a53dcd3ac60 tempest-VolumesImageMetadata-478923483 None] Lock "cinder-24e838b1-63f3-4860-986c-ef252a485a86-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Flow 'volume_create_manager' (c005015c-cabb-4fef-abeb-930098e58084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbb65d-d3f1-4ea8-add9-248904f183ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbb65d-d3f1-4ea8-add9-248904f183ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-261905172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996fb88f-3d68-49d3-8491-fe93901f8f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6762701d3f49d485fadb0e14055614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:32Z,use_quota=True,user_id='3d16cc7daa364a39924e96034909b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9f8560-f729-4ea6-8812-fdb672e63989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9f8560-f729-4ea6-8812-fdb672e63989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92161b0c-cc3e-405a-b7a1-87184bfe774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92161b0c-cc3e-405a-b7a1-87184bfe774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996fb88f-3d68-49d3-8491-fe93901f8f83', 'volume_name': 'volume-996fb88f-3d68-49d3-8491-fe93901f8f83', 'volume_size': 2}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496f8f0f-9fbe-4552-8245-83f5a54d2f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496f8f0f-9fbe-4552-8245-83f5a54d2f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4594c2-16bd-45ee-8007-b3b5442812b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Volume 996fb88f-3d68-49d3-8491-fe93901f8f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996fb88f-3d68-49d3-8491-fe93901f8f83', 'volume_size': 2}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-261905172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996fb88f-3d68-49d3-8491-fe93901f8f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6762701d3f49d485fadb0e14055614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:32Z,use_quota=True,user_id='3d16cc7daa364a39924e96034909b662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Creating volume 996fb88f-3d68-49d3-8491-fe93901f8f83 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:31 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 2147483648 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:31 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 2147483648
Sep 29 16:42:31 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:32 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 2147483648" returned: 0 in 0.538s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:32 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83
Sep 29 16:42:32 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:32 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4594c2-16bd-45ee-8007-b3b5442812b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996fb88f-3d68-49d3-8491-fe93901f8f83', 'volume_size': 2}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57053752-d25c-4f47-9c4d-81cab70b8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Volume volume-996fb88f-3d68-49d3-8491-fe93901f8f83 (996fb88f-3d68-49d3-8491-fe93901f8f83): created successfully
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57053752-d25c-4f47-9c4d-81cab70b8e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Flow 'volume_create_manager' (c005015c-cabb-4fef-abeb-930098e58084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-25229423-9cf1-4bc1-848a-1fea3849efb3 tempest-VolumesCloneNegativeTest-1524111330 None] Created volume successfully.
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Flow 'volume_create_manager' (58aa9012-e460-42ee-b19b-f2f3332d99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b2cf2-8b43-46cd-a394-23840d24564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b2cf2-8b43-46cd-a394-23840d24564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-39539006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173a97457b8c4fb68a05379a6526c6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:34Z,use_quota=True,user_id='b6030219ee544865b8272dfa4d9e8cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e20ff6-38a7-49bb-b143-b644c7418d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e20ff6-38a7-49bb-b143-b644c7418d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221167b-337f-4630-a9cc-473d64c49cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221167b-337f-4630-a9cc-473d64c49cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf', 'volume_name': 'volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a039759-2a5b-45a9-9994-a38a1e35e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a039759-2a5b-45a9-9994-a38a1e35e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52d5a83-0d59-45ce-aff2-7f2012b0d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Volume bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf', 'volume_size': 1}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-39539006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173a97457b8c4fb68a05379a6526c6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:34Z,use_quota=True,user_id='b6030219ee544865b8272dfa4d9e8cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Creating volume bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:33 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Acquiring lock "cinder-996fb88f-3d68-49d3-8491-fe93901f8f83-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "cinder-996fb88f-3d68-49d3-8491-fe93901f8f83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:34 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf 1073741824
Sep 29 16:42:34 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Acquiring lock "cinder-quobyte-996fb88f-3d68-49d3-8491-fe93901f8f83" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "cinder-quobyte-996fb88f-3d68-49d3-8491-fe93901f8f83" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be0d8f9-a9c7-4573-9c30-ad9f54837494]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:34 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83
Sep 29 16:42:34 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:34 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf 1073741824" returned: 0 in 0.540s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:34 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:34 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83
Sep 29 16:42:34 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:34 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf
Sep 29 16:42:34 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:34 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-996fb88f-3d68-49d3-8491-fe93901f8f83" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "cinder-quobyte-996fb88f-3d68-49d3-8491-fe93901f8f83" released by "delete_volume" :: held 0.803s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:34 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52d5a83-0d59-45ce-aff2-7f2012b0d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a701568e-9cd9-4355-9718-90ccbb5b1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Volume volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf (bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf): created successfully
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a701568e-9cd9-4355-9718-90ccbb5b1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Flow 'volume_create_manager' (58aa9012-e460-42ee-b19b-f2f3332d99cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-38ce6046-d46f-4592-8689-6da59c391aee tempest-AbsoluteLimitsTests-1517008690 None] Created volume successfully.
Sep 29 16:42:34 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Created reservations ['f8ed8452-f379-4a1a-bce8-fe49662abcb0', '9dedd376-0701-4755-ad0d-a3bb77d8a923', 'beafe810-ef2b-4ff5-a275-b69ae5d8e3dd', '3af95fc8-d46b-4d00-9a0e-61dea02fe556'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:35 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:35 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:35 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.333s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Deleted volume successfully.
Sep 29 16:42:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c3900b3b-6d03-43e4-8f01-8d67cbce0952 tempest-VolumesCloneNegativeTest-1524111330 None] Lock "cinder-996fb88f-3d68-49d3-8491-fe93901f8f83-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:36 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-9dfce2d1-2ec7-49f8-89b7-0a9db2fe10c4 req-1d2a61ea-c5d5-45b3-ba70-fa525455fe84 tempest-TestShelveInstance-1680077097 None] Terminate volume connection completed successfully.
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-9dfce2d1-2ec7-49f8-89b7-0a9db2fe10c4 req-1d2a61ea-c5d5-45b3-ba70-fa525455fe84 tempest-TestShelveInstance-1680077097 None] Deleting attachment d700c425-9b6d-44a0-8c35-8074c56156ba. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Acquiring lock "cinder-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "cinder-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Acquiring lock "cinder-quobyte-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "cinder-quobyte-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa68e79-5920-434b-80b8-15a124f22f44]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:36 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf
Sep 29 16:42:36 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:37 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:37 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf
Sep 29 16:42:37 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:37 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" returned: 0 in 0.304s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "cinder-quobyte-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf" released by "delete_volume" :: held 0.752s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Created reservations ['6a931383-5c2c-49ae-81b6-e20b8c284ef1', '7d5f3268-2755-46f8-8bdd-da3c56b30e73', '2dd328b4-b1c0-495e-9716-905c9662e026', '4cf4143e-7341-43a7-993d-1099ead87f3b'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:37 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:37 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:37 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Deleted volume successfully.
Sep 29 16:42:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-25fb76ef-6657-4ec5-a6f1-56608b4adb4a tempest-AbsoluteLimitsTests-1517008690 None] Lock "cinder-bf9bd7b1-2009-4bdd-bcbf-4a5a7ca4fecf-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-9002a120-1f42-45e5-a118-27876aa0e713 req-2faca8a9-7456-409d-8b2d-a77cc88dab59 tempest-TestShelveInstance-1680077097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-9002a120-1f42-45e5-a118-27876aa0e713 req-2faca8a9-7456-409d-8b2d-a77cc88dab59 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-9002a120-1f42-45e5-a118-27876aa0e713 req-2faca8a9-7456-409d-8b2d-a77cc88dab59 tempest-TestShelveInstance-1680077097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-9002a120-1f42-45e5-a118-27876aa0e713 req-2faca8a9-7456-409d-8b2d-a77cc88dab59 tempest-TestShelveInstance-1680077097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8eda29f8-bc40-4b39-a6e4-df49dbe21323', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:42:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-9002a120-1f42-45e5-a118-27876aa0e713 req-2faca8a9-7456-409d-8b2d-a77cc88dab59 tempest-TestShelveInstance-1680077097 None] attachment_update completed successfully.
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Flow 'volume_create_manager' (a0ae6f0e-96f3-4fcc-b3be-9bdd8cbaeed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb74b7-6efc-4f28-be36-505e0418f7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb74b7-6efc-4f28-be36-505e0418f7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1932825499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b687a65ec8477e85457607c035a369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:41Z,use_quota=True,user_id='95bac65dd8e94a3ab131d976818bb59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d918294-da2f-49ab-9920-4c1aad6fef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d918294-da2f-49ab-9920-4c1aad6fef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79655870-1243-4b32-a022-1885812061f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:40 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79655870-1243-4b32-a022-1885812061f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65', 'volume_name': 'volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9c1d90>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139f70b4-ed62-4d1d-afd7-edd854ba9759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139f70b4-ed62-4d1d-afd7-edd854ba9759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe2539-652c-46ab-856e-86cccc09edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:41 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9c1d90>}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Trying to clone a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 from image 5bde2f08-ba6c-4285-b385-cf604fce5707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:42:41 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08981eb-1622-46f2-b554-641fdc1d60c3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:41 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD
Sep 29 16:42:41 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:42 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 is fetched for user 95bac65dd8e94a3ab131d976818bb59f. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4bb759-379c-4b0d-ba75-97af4c223882]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:42 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD
Sep 29 16:42:42 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:42 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1932825499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b687a65ec8477e85457607c035a369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:41Z,use_quota=True,user_id='95bac65dd8e94a3ab131d976818bb59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Creating volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:42 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:42 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1073741824
Sep 29 16:42:42 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:43 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1073741824" returned: 0 in 0.630s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:43 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65
Sep 29 16:42:43 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:44 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" returned: 0 in 0.587s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Attempting download of 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d392a49-c015-483a-bbc3-d81067bcecae]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:44 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc
Sep 29 16:42:44 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:44 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc" returned: 0 in 0.473s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:44 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc
Sep 29 16:42:44 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:45 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc" returned: 1 in 0.451s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_eaq7i5xc' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[206614f0-3cc4-4455-8ac8-1943464fc401]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:45 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD
Sep 29 16:42:45 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:45 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] 5bde2f08-ba6c-4285-b385-cf604fce5707 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:42:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:45 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65
Sep 29 16:42:45 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:46 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Flow 'volume_create_manager' (edeb49af-ee2e-43cc-b359-b0db5902c05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746f0f21-a402-4219-a011-dc0b26dee0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746f0f21-a402-4219-a011-dc0b26dee0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-191046281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d35dfb-ded9-4897-97d4-1b9391f76592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6130866e264b9cb007081d63500e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:47Z,use_quota=True,user_id='35d6f21a2f0240e881f46ea6fb56adc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e38b03b-09af-4b7d-9b97-39ed9dbd60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e38b03b-09af-4b7d-9b97-39ed9dbd60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d788618c-f760-4977-beb2-2c903b6125f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d788618c-f760-4977-beb2-2c903b6125f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d35dfb-ded9-4897-97d4-1b9391f76592', 'volume_name': 'volume-c6d35dfb-ded9-4897-97d4-1b9391f76592', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3a2c2-9d3f-4518-b6dc-d0f1ca245f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3a2c2-9d3f-4518-b6dc-d0f1ca245f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec623dec-02a7-4ca3-a554-026bed9b6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Volume c6d35dfb-ded9-4897-97d4-1b9391f76592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d35dfb-ded9-4897-97d4-1b9391f76592', 'volume_size': 1}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-191046281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d35dfb-ded9-4897-97d4-1b9391f76592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6130866e264b9cb007081d63500e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:47Z,use_quota=True,user_id='35d6f21a2f0240e881f46ea6fb56adc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Creating volume c6d35dfb-ded9-4897-97d4-1b9391f76592 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:47 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:47 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 1073741824
Sep 29 16:42:47 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:47 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 1073741824" returned: 0 in 0.633s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:47 devstack sudo[101187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592
Sep 29 16:42:47 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:48 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" returned: 0 in 2.627s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_a964dqggdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:42:48 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Converted 112.00 MB image at 42.61 MB/s
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:48 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:48 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1G
Sep 29 16:42:48 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec623dec-02a7-4ca3-a554-026bed9b6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d35dfb-ded9-4897-97d4-1b9391f76592', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63798bc1-db1b-40b7-9c55-7b0dcc0288c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:48 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Volume volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 (c6d35dfb-ded9-4897-97d4-1b9391f76592): created successfully
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63798bc1-db1b-40b7-9c55-7b0dcc0288c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Flow 'volume_create_manager' (edeb49af-ee2e-43cc-b359-b0db5902c05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-be0c1722-b3b8-48d0-9458-968f8b5c6efe tempest-VolumesTransfersV355Test-1698425129 None] Created volume successfully.
Sep 29 16:42:48 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 1G" returned: 0 in 0.459s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Downloaded image 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 for user 95bac65dd8e94a3ab131d976818bb59f is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Marking volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Copying metadata from image 5bde2f08-ba6c-4285-b385-cf604fce5707 to a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Creating volume glance metadata for volume a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 backed by image 5bde2f08-ba6c-4285-b385-cf604fce5707 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe2539-652c-46ab-856e-86cccc09edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9c1d90>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d5a000-9665-40c0-8b1f-69dd1617a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:48 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Volume volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 (a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65): created successfully
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d5a000-9665-40c0-8b1f-69dd1617a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Flow 'volume_create_manager' (a0ae6f0e-96f3-4fcc-b3be-9bdd8cbaeed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0c513064-9a51-47c7-9d4c-01c39f62c3a6 tempest-VolumesExtendTest-1630377630 None] Created volume successfully.
Sep 29 16:42:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe9d6f-216b-4080-822f-36eb92e104e8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:49 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65
Sep 29 16:42:49 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8f0addd4-48d8-45f2-bcc0-ef8f7418a934 tempest-VolumesTransfersV355Test-1237034160 None] Transfer volume completed successfully.
Sep 29 16:42:50 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" returned: 0 in 0.498s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 2G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 2G" returned: 0 in 0.122s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.667s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-23d97852-21e9-4e56-ac65-b0bd0d72c6ef tempest-VolumesExtendTest-1630377630 None] Extend volume completed successfully.
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "cinder-c6d35dfb-ded9-4897-97d4-1b9391f76592-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-c6d35dfb-ded9-4897-97d4-1b9391f76592-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "cinder-quobyte-c6d35dfb-ded9-4897-97d4-1b9391f76592" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-quobyte-c6d35dfb-ded9-4897-97d4-1b9391f76592" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb38a2-c65f-417e-af3a-3803e0a925c3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:50 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592
Sep 29 16:42:50 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:51 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592" returned: 0 in 0.448s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:51 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592
Sep 29 16:42:51 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-quobyte-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59215ed-3b64-4bfc-98b6-3781ad24244a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:51 devstack sudo[101219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65
Sep 29 16:42:51 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:51 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c6d35dfb-ded9-4897-97d4-1b9391f76592" returned: 0 in 0.340s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-quobyte-c6d35dfb-ded9-4897-97d4-1b9391f76592" released by "delete_volume" :: held 0.839s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Created reservations ['247498fc-178b-44ec-902d-2541ae90421a', 'ccd94b53-8326-4e61-9960-2e88a15b9eef', 'a8fe23b1-39d8-43bf-84c5-b470314e8d06', '1352a163-8106-4ebb-87c0-74161492d137'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:51 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:51 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:51 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" returned: 0 in 0.495s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:51 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65
Sep 29 16:42:51 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:52 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Deleted volume successfully.
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6bca6b69-4aa9-4b9e-8870-03517e60eeab tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-c6d35dfb-ded9-4897-97d4-1b9391f76592-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:52 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" returned: 0 in 0.411s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65" released by "delete_volume" :: held 0.967s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Created reservations ['079cc785-31c9-4397-b3dc-deb5762fcd26', '32341a3f-b439-42b7-9578-14125f3dba38', '1fb12e41-cfbe-46ba-8bf2-0fcda8f6a896', '45f1140b-4830-4aa2-bd0b-c20706acf5ff'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:52 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:52 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Flow 'volume_create_manager' (165ec89d-9604-47ca-85a7-724fb45dbb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab750e20-db0b-4a2a-9085-13b3cc3998ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab750e20-db0b-4a2a-9085-13b3cc3998ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1970012045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed113f0-c55a-4a1f-a176-1a2032575457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6130866e264b9cb007081d63500e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:53Z,use_quota=True,user_id='35d6f21a2f0240e881f46ea6fb56adc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b950a731-42c4-4bda-9e02-a03e43388a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b950a731-42c4-4bda-9e02-a03e43388a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a031d32-ce9f-4ac7-b633-1e4288426e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a031d32-ce9f-4ac7-b633-1e4288426e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed113f0-c55a-4a1f-a176-1a2032575457', 'volume_name': 'volume-eed113f0-c55a-4a1f-a176-1a2032575457', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3398a9db-ac61-4649-8844-3346b7df7097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3398a9db-ac61-4649-8844-3346b7df7097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de98e2c1-0244-4f0b-8a6e-61b05c977732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Volume eed113f0-c55a-4a1f-a176-1a2032575457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed113f0-c55a-4a1f-a176-1a2032575457', 'volume_size': 1}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1970012045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed113f0-c55a-4a1f-a176-1a2032575457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6130866e264b9cb007081d63500e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:53Z,use_quota=True,user_id='35d6f21a2f0240e881f46ea6fb56adc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Creating volume eed113f0-c55a-4a1f-a176-1a2032575457 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:52 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:52 devstack sudo[101233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 1073741824
Sep 29 16:42:52 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:52 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.335s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Deleted volume successfully.
Sep 29 16:42:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-58d19fc0-09d4-42c5-afdc-b7a8ea613006 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-a5e7d0d0-fb8a-4bd3-bb9a-7649f191ca65-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:53 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 1073741824" returned: 0 in 0.483s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:53 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457
Sep 29 16:42:53 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:53 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de98e2c1-0244-4f0b-8a6e-61b05c977732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed113f0-c55a-4a1f-a176-1a2032575457', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2aad9e-1795-4013-b2f7-1c441b4e6843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Volume volume-eed113f0-c55a-4a1f-a176-1a2032575457 (eed113f0-c55a-4a1f-a176-1a2032575457): created successfully
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2aad9e-1795-4013-b2f7-1c441b4e6843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Flow 'volume_create_manager' (165ec89d-9604-47ca-85a7-724fb45dbb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c711bdcd-6e2e-482b-910d-c9bcb13fa198 tempest-VolumesTransfersV355Test-1698425129 None] Created volume successfully.
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:53 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:53 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:53 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:42:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Flow 'volume_create_manager' (5b62af26-3697-41a5-b1d8-304e40490bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16c873c-84a1-4a0b-826f-a50e1b96fd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16c873c-84a1-4a0b-826f-a50e1b96fd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1210823626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22a012c-14d4-41cf-b47d-ed8a47140f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b687a65ec8477e85457607c035a369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:54Z,use_quota=True,user_id='95bac65dd8e94a3ab131d976818bb59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11fabda-eca0-474b-abbe-a4546a67881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11fabda-eca0-474b-abbe-a4546a67881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282cc8e3-2967-4f51-8a83-08220ed278c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282cc8e3-2967-4f51-8a83-08220ed278c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22a012c-14d4-41cf-b47d-ed8a47140f38', 'volume_name': 'volume-d22a012c-14d4-41cf-b47d-ed8a47140f38', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193fdbb-73ed-4e78-b002-54bab8ec6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193fdbb-73ed-4e78-b002-54bab8ec6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e6fec2-e9f9-47bb-9c59-9e8b787941de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:54 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Volume d22a012c-14d4-41cf-b47d-ed8a47140f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22a012c-14d4-41cf-b47d-ed8a47140f38', 'volume_size': 1}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1210823626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22a012c-14d4-41cf-b47d-ed8a47140f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b687a65ec8477e85457607c035a369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:54Z,use_quota=True,user_id='95bac65dd8e94a3ab131d976818bb59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Creating volume d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:42:54 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:54 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 1073741824
Sep 29 16:42:54 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:54 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 1073741824" returned: 0 in 0.465s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:54 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:42:54 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "cinder-eed113f0-c55a-4a1f-a176-1a2032575457-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-eed113f0-c55a-4a1f-a176-1a2032575457-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:54 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.345s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e6fec2-e9f9-47bb-9c59-9e8b787941de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22a012c-14d4-41cf-b47d-ed8a47140f38', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80acef73-05d2-4ec0-916f-9769b55c7f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:42:55 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Volume volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 (d22a012c-14d4-41cf-b47d-ed8a47140f38): created successfully
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80acef73-05d2-4ec0-916f-9769b55c7f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Flow 'volume_create_manager' (5b62af26-3697-41a5-b1d8-304e40490bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "cinder-quobyte-eed113f0-c55a-4a1f-a176-1a2032575457" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:42:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6656de3e-ef19-4b6d-9c44-802a7b54a871 tempest-VolumesExtendTest-1630377630 None] Created volume successfully.
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-quobyte-eed113f0-c55a-4a1f-a176-1a2032575457" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4da581-8c0e-4b32-98f5-5ebff17fd529]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:55 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457
Sep 29 16:42:55 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:55 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457" returned: 0 in 0.405s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:55 devstack sudo[101259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457
Sep 29 16:42:55 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:55 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-eed113f0-c55a-4a1f-a176-1a2032575457" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-quobyte-eed113f0-c55a-4a1f-a176-1a2032575457" released by "delete_volume" :: held 0.710s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Created reservations ['ad5ee30c-3dd4-4175-a3c6-e379bd16581e', '123feb3d-d053-4f43-9caa-e484b6e16514', '8f3b7439-e6f8-4368-8aab-301d9959c825', '163baa04-6be9-42a0-b390-425915653cb9'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:55 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:42:55 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:56 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.317s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:42:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Deleted volume successfully.
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c0ea9cd5-60fd-4b87-bdab-cbb9baa7240d tempest-VolumesTransfersV355Test-1320952241 None] Lock "cinder-eed113f0-c55a-4a1f-a176-1a2032575457-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Creating offline snapshot f9bec265-bf22-4856-acb6-801d6fdd27f4 of volume d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb32754-e437-4a75-a57b-f4e5772f9dd9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:56 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:42:56 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:56 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.419s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:56 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 1G
Sep 29 16:42:56 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:57 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 1G" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:57 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4
Sep 29 16:42:57 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:57 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4" returned: 0 in 0.346s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:57 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 is being set with open permissions: ugo+rw
Sep 29 16:42:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:57 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4
Sep 29 16:42:57 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:58 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:58 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info
Sep 29 16:42:58 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:58 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info" returned: 0 in 0.323s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:58 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info is being set with open permissions: ugo+rw
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:58 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info
Sep 29 16:42:58 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:42:58 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.info" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:42:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:42:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c049e55b-3347-424e-9f90-a178382ab87c tempest-VolumesExtendTest-1630377630 None] Create snapshot completed successfully
Sep 29 16:42:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:42:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:42:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd0729-2fc4-4ac4-b722-59b87501dd57]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:42:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:42:59 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:42:59 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:00 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.445s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 2G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 2G" returned: 0 in 0.160s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:00 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=160,cinder:DELETE=16,cinder:SELECT=123,cinder:INSERT=49 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:43:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6543c78e-be27-43af-847d-20f0eaa77d9f tempest-VolumesExtendTest-1630377630 None] Extend volume completed successfully.
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-f9bec265-bf22-4856-acb6-801d6fdd27f4-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-f9bec265-bf22-4856-acb6-801d6fdd27f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-quobyte-f9bec265-bf22-4856-acb6-801d6fdd27f4" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-f9bec265-bf22-4856-acb6-801d6fdd27f4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Deleting offline snapshot f9bec265-bf22-4856-acb6-801d6fdd27f4 of volume d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] snapshot_file for this snap is: volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8283680-352b-41f7-96f5-221edd555797]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:01 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4
Sep 29 16:43:01 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:01 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22a012c-14d4-41cf-b47d-ed8a47140f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afe9a1-cb2b-4914-a95f-5af7ba4d42e5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:01 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:43:01 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:02 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.453s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:02 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4
Sep 29 16:43:02 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:02 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4" returned: 0 in 0.511s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:02 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4
Sep 29 16:43:02 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:02 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38.f9bec265-bf22-4856-acb6-801d6fdd27f4" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-f9bec265-bf22-4856-acb6-801d6fdd27f4" released by "_delete_snapshot" :: held 1.820s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" released by "delete_snapshot" :: held 1.850s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:02 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=131,cinder:INSERT=47,cinder:UPDATE=166,cinder:DELETE=13 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Created reservations ['0a3cb6f3-b45e-49d8-a906-e30ec6670711', '47f53fa3-990e-4494-80a6-24daa4d55570', 'd5d3bc95-3a8d-47de-b4be-88f443ef1f29', 'fb1aabfb-dace-4d4b-ab75-95eb86bc9536'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Delete snapshot completed successfully.
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c6756c0a-04f8-44f7-bf5d-4dedd59d9070 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-f9bec265-bf22-4856-acb6-801d6fdd27f4-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-d22a012c-14d4-41cf-b47d-ed8a47140f38-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-d22a012c-14d4-41cf-b47d-ed8a47140f38-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503818a-1435-4b0f-af52-5357283203f7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:03 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:43:03 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:03 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.419s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:03 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38
Sep 29 16:43:03 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:04 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d22a012c-14d4-41cf-b47d-ed8a47140f38" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-quobyte-d22a012c-14d4-41cf-b47d-ed8a47140f38" released by "delete_volume" :: held 0.838s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Created reservations ['d0cd4e73-2780-46c8-9f28-0b11b7fed500', '333449a0-fdc6-4041-8f4e-741e163b5e18', '4c9935db-ba07-413a-acfe-c3665fe530b1', '29d75983-8a51-43a9-9a57-75c64afd51fc'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:04 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:04 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:04 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.277s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Deleted volume successfully.
Sep 29 16:43:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cfce2895-8bde-4fab-bf0c-0f41a0657578 tempest-VolumesExtendTest-1630377630 None] Lock "cinder-d22a012c-14d4-41cf-b47d-ed8a47140f38-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (6a37956f-4ff1-448c-bdaa-1439c03c7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d25223-4afd-4d2c-aa92-9b83ffc5cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d25223-4afd-4d2c-aa92-9b83ffc5cae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1636838399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7656d95f-a978-449f-9d27-60349337ba31,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:09Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f34ff-480f-4f2f-ac78-46c55b8c8d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f34ff-480f-4f2f-ac78-46c55b8c8d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de0df99-090a-423c-88e7-fa69a22c2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de0df99-090a-423c-88e7-fa69a22c2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7656d95f-a978-449f-9d27-60349337ba31', 'volume_name': 'volume-7656d95f-a978-449f-9d27-60349337ba31', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd42159-63f3-4a37-bb28-90f4fce4c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd42159-63f3-4a37-bb28-90f4fce4c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97870f5d-715d-48ae-8ce3-65c28b120970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Volume 7656d95f-a978-449f-9d27-60349337ba31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7656d95f-a978-449f-9d27-60349337ba31', 'volume_size': 1}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1636838399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7656d95f-a978-449f-9d27-60349337ba31,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:09Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Creating volume 7656d95f-a978-449f-9d27-60349337ba31 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:08 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:08 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 1073741824
Sep 29 16:43:08 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:09 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 1073741824" returned: 0 in 0.544s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:09 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31
Sep 29 16:43:09 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:09 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31" returned: 0 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97870f5d-715d-48ae-8ce3-65c28b120970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7656d95f-a978-449f-9d27-60349337ba31', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac4f4c-9ad7-4ecd-9d96-d6fe21100451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Volume volume-7656d95f-a978-449f-9d27-60349337ba31 (7656d95f-a978-449f-9d27-60349337ba31): created successfully
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac4f4c-9ad7-4ecd-9d96-d6fe21100451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (6a37956f-4ff1-448c-bdaa-1439c03c7459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0cc66391-f293-446e-b0f7-dc3479cb48f6 tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (1770f3b7-a078-487b-8c18-b0efde671bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e752fe51-17b5-48b4-a32f-b755b566e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e752fe51-17b5-48b4-a32f-b755b566e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-872118327',display_name='tempest-VolumesGetTest-Volume-618209108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a326c2a-7d6e-43a5-a322-e1a6d3fdca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:12Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47125aa-6b2e-48d8-bdbd-457d635fcf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47125aa-6b2e-48d8-bdbd-457d635fcf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1714e59-1222-4c4f-9539-4e40b68fa353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1714e59-1222-4c4f-9539-4e40b68fa353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a326c2a-7d6e-43a5-a322-e1a6d3fdca75', 'volume_name': 'volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2161fe4-8201-416c-af5a-bc8be4f2afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2161fe4-8201-416c-af5a-bc8be4f2afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b98aed-c1d7-4e90-a9fc-23c38bd2b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Volume 4a326c2a-7d6e-43a5-a322-e1a6d3fdca75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75', 'volume_size': 1}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-872118327',display_name='tempest-VolumesGetTest-Volume-618209108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a326c2a-7d6e-43a5-a322-e1a6d3fdca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:12Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Creating volume 4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:11 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:11 devstack sudo[101375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 1073741824
Sep 29 16:43:11 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:12 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 1073741824" returned: 0 in 0.528s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:12 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75
Sep 29 16:43:12 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:12 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" returned: 0 in 0.305s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b98aed-c1d7-4e90-a9fc-23c38bd2b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833e820-b77b-453f-a576-71d0859c3bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:12 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Volume volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 (4a326c2a-7d6e-43a5-a322-e1a6d3fdca75): created successfully
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833e820-b77b-453f-a576-71d0859c3bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (1770f3b7-a078-487b-8c18-b0efde671bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-08dc0728-398b-475f-aa71-1b5bd1394d3c tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "cinder-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c5567-7dd7-434d-8085-529de316e713]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:14 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75
Sep 29 16:43:14 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Flow 'volume_create_manager' (77591901-981d-44fb-8bcb-28886914f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52e026e-2bec-4c9d-ba47-b69021c112ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52e026e-2bec-4c9d-ba47-b69021c112ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-468517920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8781ace1-fc17-45b0-8908-fe71c23182c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb91ea0c27f43c1a8b8425b00203bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:14Z,use_quota=True,user_id='e791786f0c1c473491f1406d5a591cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd2b6ff-ff11-4a54-affa-7eeeb2c2f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd2b6ff-ff11-4a54-affa-7eeeb2c2f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd92d54-4075-4679-bcec-855340a6fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:14 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd92d54-4075-4679-bcec-855340a6fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8781ace1-fc17-45b0-8908-fe71c23182c8', 'volume_name': 'volume-8781ace1-fc17-45b0-8908-fe71c23182c8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aceaf5d-8625-4b6c-9ee7-b61da0aa736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aceaf5d-8625-4b6c-9ee7-b61da0aa736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb23fb-edbd-409b-83eb-3cb11b40e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:14 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Volume 8781ace1-fc17-45b0-8908-fe71c23182c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8781ace1-fc17-45b0-8908-fe71c23182c8', 'volume_size': 1}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-468517920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8781ace1-fc17-45b0-8908-fe71c23182c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edb91ea0c27f43c1a8b8425b00203bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:14Z,use_quota=True,user_id='e791786f0c1c473491f1406d5a591cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Creating volume 8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:14 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:14 devstack sudo[101392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 1073741824
Sep 29 16:43:14 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:14 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75
Sep 29 16:43:14 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:14 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" returned: 0 in 0.267s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75" released by "delete_volume" :: held 0.754s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Created reservations ['e6b38d13-b716-40b4-9a24-a2f95872be84', '0ccb8b1c-e23e-47d1-9e19-370c317be52a', 'b9fb018e-ebd5-4186-a89a-54a8cba94a04', '47750a83-ef53-49fb-8283-7a2a15570375'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:14 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:14 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:14 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 1073741824" returned: 0 in 0.471s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:14 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:43:14 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:15 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a32a2a6a-fb0b-4bf5-9690-2002775ea33c tempest-VolumesGetTest-1007308239 None] Lock "cinder-4a326c2a-7d6e-43a5-a322-e1a6d3fdca75-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:15 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.278s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb23fb-edbd-409b-83eb-3cb11b40e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8781ace1-fc17-45b0-8908-fe71c23182c8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f90a4cd-3658-4371-99a9-9eeed5d15d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:15 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Volume volume-8781ace1-fc17-45b0-8908-fe71c23182c8 (8781ace1-fc17-45b0-8908-fe71c23182c8): created successfully
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f90a4cd-3658-4371-99a9-9eeed5d15d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Flow 'volume_create_manager' (77591901-981d-44fb-8bcb-28886914f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bce9da93-2fd9-40a1-a7e2-de8e6340ae87 tempest-VolumesActionsTest-519560619 None] Created volume successfully.
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-7656d95f-a978-449f-9d27-60349337ba31-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "cinder-7656d95f-a978-449f-9d27-60349337ba31-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-7656d95f-a978-449f-9d27-60349337ba31" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-7656d95f-a978-449f-9d27-60349337ba31" acquired by "delete_volume" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef6d9ea-3b25-448b-bce2-8e612496700c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:15 devstack sudo[101407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31
Sep 29 16:43:15 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:15 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31" returned: 0 in 0.353s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:15 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31
Sep 29 16:43:15 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:16 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7656d95f-a978-449f-9d27-60349337ba31" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-7656d95f-a978-449f-9d27-60349337ba31" released by "delete_volume" :: held 0.644s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Created reservations ['a9cc525b-dabe-49a9-ab7c-343b37fbd8ef', '4e71e81f-e583-4949-b2a5-482fb2a44f76', 'ba9ea61a-a16c-455b-ae81-51a2e6fd8a51', '7a32055b-bfeb-4111-a6f0-2c023d6900e2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:16 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:16 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:16 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e80ea98-7204-47e1-aa80-ffa34fcf5747 tempest-VolumesGetTest-1007308239 None] Lock "cinder-7656d95f-a978-449f-9d27-60349337ba31-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (c38b4ae8-b501-47ce-98c0-e0f7e8ef952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cdf424-da55-41f9-80b3-a1be4ad83928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cdf424-da55-41f9-80b3-a1be4ad83928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1695217785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:17Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8481cc7-646f-45e2-99a4-83aab9527590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8481cc7-646f-45e2-99a4-83aab9527590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c493a32-4f4e-433b-a314-97bdec33a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c493a32-4f4e-433b-a314-97bdec33a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'volume_name': 'volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779d6331-76d4-494e-8a35-854b89c9a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779d6331-76d4-494e-8a35-854b89c9a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7ce5c-2acf-423d-ba9c-3c7695854e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Volume 92ed5f09-c4f7-4163-ac2e-b5d4252abe2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'volume_size': 1}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1695217785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:17Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Creating volume 92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:17 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:17 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d 1073741824
Sep 29 16:43:17 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:17 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d 1073741824" returned: 0 in 0.510s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:17 devstack sudo[101427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:17 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:17 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7ce5c-2acf-423d-ba9c-3c7695854e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9e6f4a-0c3b-42c2-8c3e-9bf5b47243c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Volume volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d (92ed5f09-c4f7-4163-ac2e-b5d4252abe2d): created successfully
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9e6f4a-0c3b-42c2-8c3e-9bf5b47243c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (c38b4ae8-b501-47ce-98c0-e0f7e8ef952e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-76ebc42c-fa24-43fc-b4be-0fc00f9b1d9c tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (8a11eae6-d903-4678-acf4-8fd0f1a3cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98be2ce0-7dad-4ddb-a20c-94740622c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98be2ce0-7dad-4ddb-a20c-94740622c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1064905987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8862ac01-f692-4144-9249-077c748486cb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:20Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f69ea9-2a76-4a28-92cb-d3e03a20f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f69ea9-2a76-4a28-92cb-d3e03a20f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3e8924-1a43-4b79-93e5-db4440cd2f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3e8924-1a43-4b79-93e5-db4440cd2f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8862ac01-f692-4144-9249-077c748486cb', 'volume_name': 'volume-8862ac01-f692-4144-9249-077c748486cb', 'volume_size': 1, 'source_volid': '92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'source_volstatus': 'available'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba61907e-2551-41f8-ba86-e077367896dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba61907e-2551-41f8-ba86-e077367896dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d776f24-4aa1-4339-b4f5-82e8ecec7b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:19 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Volume 8862ac01-f692-4144-9249-077c748486cb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8862ac01-f692-4144-9249-077c748486cb', 'volume_size': 1, 'source_volid': '92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'source_volstatus': 'available'}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:19 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Cloning volume 92ed5f09-c4f7-4163-ac2e-b5d4252abe2d to volume 8862ac01-f692-4144-9249-077c748486cb
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Creating offline snapshot 82b38ddd-4bcf-413c-9f02-d53369c2a239 of volume 92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954b046-02fc-44da-ab15-f87302ad12e5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:19 devstack sudo[101445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:19 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:20 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:20 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 1G
Sep 29 16:43:20 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:20 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 1G" returned: 0 in 0.502s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:20 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:20 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:21 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.549s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:21 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 is being set with open permissions: ugo+rw
Sep 29 16:43:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:21 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:21 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:21 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:21 devstack sudo[101520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info
Sep 29 16:43:21 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:22 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info" returned: 0 in 0.360s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:22 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info is being set with open permissions: ugo+rw
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:22 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info
Sep 29 16:43:22 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:22 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.info" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] snapshot: 82b38ddd-4bcf-413c-9f02-d53369c2a239, volume: 8862ac01-f692-4144-9249-077c748486cb,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e91752-d303-4fad-a54b-e0c306e9357a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:22 devstack sudo[101554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:22 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:22 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e8c85-025b-484d-9712-763b7cdb8136]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:22 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:22 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:23 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:43:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:43:23 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:43:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:23 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb
Sep 29 16:43:23 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a154d4cc-1057-418d-bd5c-c6eefe83e9fd tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" by "attach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a154d4cc-1057-418d-bd5c-c6eefe83e9fd tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" acquired by "attach_volume" :: waited 0.039s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a154d4cc-1057-418d-bd5c-c6eefe83e9fd tempest-VolumesActionsTest-519560619 None] Attaching volume 8781ace1-fc17-45b0-8908-fe71c23182c8 to instance a4fcb25d-954f-40f1-a0fe-8d99d6a68c29 at mountpoint /dev/vdb on host None.
Sep 29 16:43:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a154d4cc-1057-418d-bd5c-c6eefe83e9fd tempest-VolumesActionsTest-519560619 None] Attach volume completed successfully.
Sep 29 16:43:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a154d4cc-1057-418d-bd5c-c6eefe83e9fd tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" released by "attach_volume" :: held 0.265s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00e4695e-d27f-4cd1-b21f-139c539dd2fe tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" by "detach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00e4695e-d27f-4cd1-b21f-139c539dd2fe tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-00e4695e-d27f-4cd1-b21f-139c539dd2fe tempest-VolumesActionsTest-519560619 None] Detaching volume 8781ace1-fc17-45b0-8908-fe71c23182c8 from instance a4fcb25d-954f-40f1-a0fe-8d99d6a68c29.
Sep 29 16:43:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-00e4695e-d27f-4cd1-b21f-139c539dd2fe tempest-VolumesActionsTest-519560619 None] Detach volume completed successfully.
Sep 29 16:43:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00e4695e-d27f-4cd1-b21f-139c539dd2fe tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" released by "detach_volume" :: held 0.242s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-34889eab-bedf-40b4-8490-7281aaf93bad tempest-TestShelveInstance-1680077097 None] Terminate volume connection completed successfully.
Sep 29 16:43:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-34889eab-bedf-40b4-8490-7281aaf93bad tempest-TestShelveInstance-1680077097 None] Deleting attachment 8eda29f8-bc40-4b39-a6e4-df49dbe21323. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:43:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Acquiring lock "cinder-4d31e75b-753b-41b1-9843-fa05f32e6a6a-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "cinder-4d31e75b-753b-41b1-9843-fa05f32e6a6a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Acquiring lock "cinder-quobyte-4d31e75b-753b-41b1-9843-fa05f32e6a6a" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "cinder-quobyte-4d31e75b-753b-41b1-9843-fa05f32e6a6a" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:32 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4c26e-0b5f-4eaf-a073-fd21ee5520f3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:32 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a
Sep 29 16:43:32 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:33 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a" returned: 0 in 0.821s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:33 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a
Sep 29 16:43:33 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:33 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb" returned: 0 in 10.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d, size 1024.00 MB, duration 10.24 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:43:33 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Converted 1024.00 MB image at 99.97 MB/s
Sep 29 16:43:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb is being set with open permissions: ugo+rw
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:33 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4d31e75b-753b-41b1-9843-fa05f32e6a6a" returned: 0 in 0.490s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:33 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb
Sep 29 16:43:33 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "cinder-quobyte-4d31e75b-753b-41b1-9843-fa05f32e6a6a" released by "delete_volume" :: held 1.400s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.quota [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Created reservations ['36371c82-bec7-4f16-bce9-fcc9c3347140', '66a805bd-3699-439c-9b48-b9d6b8f73d5a', '9155639c-e6ce-49f5-82c0-8b0acb1e5472', '87338580-ba17-4601-8aa6-841b9bdcae08'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:33 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:33 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:33 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" released by "_copy_volume_from_snapshot" :: held 11.397s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-82b38ddd-4bcf-413c-9f02-d53369c2a239" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-82b38ddd-4bcf-413c-9f02-d53369c2a239" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Deleting offline snapshot 82b38ddd-4bcf-413c-9f02-d53369c2a239 of volume 92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] snapshot_file for this snap is: volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d263be-d48d-44c5-a0b6-04fc472c49f7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:33 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.270s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.manager [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Deleted volume successfully.
Sep 29 16:43:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [req-125afbbb-4ba3-4003-bbae-9a0b4705c6b2 req-1033c99e-8909-41bf-acf0-9e26f953f328 tempest-TestShelveInstance-1680077097 None] Lock "cinder-4d31e75b-753b-41b1-9843-fa05f32e6a6a-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:33 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:33 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:34 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:43:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf825405-c780-4c3c-831e-047b926010d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:34 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:34 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:34 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.669s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:35 devstack sudo[101680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:35 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:35 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.436s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:35 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239
Sep 29 16:43:35 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:35 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d.82b38ddd-4bcf-413c-9f02-d53369c2a239" returned: 0 in 0.333s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-82b38ddd-4bcf-413c-9f02-d53369c2a239" released by "_delete_snapshot" :: held 1.986s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.075s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d776f24-4aa1-4339-b4f5-82e8ecec7b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8862ac01-f692-4144-9249-077c748486cb', 'volume_size': 1, 'source_volid': '92ed5f09-c4f7-4163-ac2e-b5d4252abe2d', 'source_volstatus': 'available'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a6249a-6078-46ac-95c6-329a6e05ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Volume volume-8862ac01-f692-4144-9249-077c748486cb (8862ac01-f692-4144-9249-077c748486cb): created successfully
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a6249a-6078-46ac-95c6-329a6e05ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (8a11eae6-d903-4678-acf4-8fd0f1a3cee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-576fb2ad-cd06-4c2a-9453-0f9ca6cb27d5 tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (8885623c-1fd2-4920-85c6-27342f7710f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98611254-cbf2-484f-b1a7-0ff015caa350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98611254-cbf2-484f-b1a7-0ff015caa350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-756259429',display_name='tempest-VolumesGetTest-Volume-1598366517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac81bc0b-46aa-4263-97a8-e6f2da2ec38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:37Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aeccba-9a53-4540-a6c1-f61c6c075efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aeccba-9a53-4540-a6c1-f61c6c075efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8f183b-d8f6-45c3-a244-9c505976d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8f183b-d8f6-45c3-a244-9c505976d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac81bc0b-46aa-4263-97a8-e6f2da2ec38d', 'volume_name': 'volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c078eb3-473c-4127-8e8f-00629f12ce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c078eb3-473c-4127-8e8f-00629f12ce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb22413-7283-463b-9e70-5526e2145e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Volume ac81bc0b-46aa-4263-97a8-e6f2da2ec38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d', 'volume_size': 1}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-756259429',display_name='tempest-VolumesGetTest-Volume-1598366517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac81bc0b-46aa-4263-97a8-e6f2da2ec38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:37Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Creating volume ac81bc0b-46aa-4263-97a8-e6f2da2ec38d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:37 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:37 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d 1073741824
Sep 29 16:43:37 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:38 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d 1073741824" returned: 0 in 0.528s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:38 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d
Sep 29 16:43:38 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:38 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" returned: 0 in 0.278s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb22413-7283-463b-9e70-5526e2145e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adac6b14-693e-450f-8882-a26d81186c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Volume volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d (ac81bc0b-46aa-4263-97a8-e6f2da2ec38d): created successfully
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adac6b14-693e-450f-8882-a26d81186c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (8885623c-1fd2-4920-85c6-27342f7710f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-fee683e8-568a-41e7-b42c-8ec2c7a35147 tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "cinder-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b97f648-2a5d-4bf8-89d9-6ed110f53ed7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:40 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d
Sep 29 16:43:40 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:40 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" returned: 0 in 0.443s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:40 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d
Sep 29 16:43:40 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:40 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d" released by "delete_volume" :: held 0.822s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:40 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Created reservations ['03fe2181-e467-432b-b9c0-2494ad7c8026', 'c3752fd1-93a1-434e-930b-f75777fd840f', '56d6ef42-c920-4095-8350-02a3c108ca20', 'e289fb4c-7287-49e8-840a-20568cb27b92'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:41 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:41 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-8862ac01-f692-4144-9249-077c748486cb-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "cinder-8862ac01-f692-4144-9249-077c748486cb-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:41 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.487s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a95e1a8-5d0a-4df6-80f4-6907e017584d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0eba61d3-f9e0-429c-a579-2d6f56a04e6b tempest-VolumesGetTest-1007308239 None] Lock "cinder-ac81bc0b-46aa-4263-97a8-e6f2da2ec38d-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:41 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb
Sep 29 16:43:41 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:42 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb" returned: 0 in 0.483s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:42 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb
Sep 29 16:43:42 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:42 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8862ac01-f692-4144-9249-077c748486cb" returned: 0 in 0.312s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-8862ac01-f692-4144-9249-077c748486cb" released by "delete_volume" :: held 0.897s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Created reservations ['49c20d52-3e29-4d36-b05b-bf2957a734d0', '295d1c95-1a33-4fa8-9aff-5b6a7d496be9', 'd6e309c8-c145-4704-be6c-d89eea208d01', '5e972b9b-19fc-4d2c-a9e2-61ba189f8aaf'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:42 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:42 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f8846fa5-f7d7-4406-bf5c-2ea334a56282 tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" by "attach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f8846fa5-f7d7-4406-bf5c-2ea334a56282 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" acquired by "attach_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:42 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.343s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:42 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:43:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f8846fa5-f7d7-4406-bf5c-2ea334a56282 tempest-VolumesActionsTest-519560619 None] Attaching volume 8781ace1-fc17-45b0-8908-fe71c23182c8 to instance 65c43b94-10b4-49a7-bb2a-ed630796a1c9 at mountpoint /dev/vdb on host None.
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5319f403-bf9d-4f0a-907d-519eda9501f1 tempest-VolumesGetTest-1007308239 None] Lock "cinder-8862ac01-f692-4144-9249-077c748486cb-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f8846fa5-f7d7-4406-bf5c-2ea334a56282 tempest-VolumesActionsTest-519560619 None] Attach volume completed successfully.
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f8846fa5-f7d7-4406-bf5c-2ea334a56282 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8" released by "attach_volume" :: held 0.127s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da11984b-5a42-4f97-a158-f3cbcba9ef54 tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" by "detach_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da11984b-5a42-4f97-a158-f3cbcba9ef54 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-da11984b-5a42-4f97-a158-f3cbcba9ef54 tempest-VolumesActionsTest-519560619 None] Detaching volume 8781ace1-fc17-45b0-8908-fe71c23182c8 from instance 65c43b94-10b4-49a7-bb2a-ed630796a1c9.
Sep 29 16:43:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-da11984b-5a42-4f97-a158-f3cbcba9ef54 tempest-VolumesActionsTest-519560619 None] Detach volume completed successfully.
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-da11984b-5a42-4f97-a158-f3cbcba9ef54 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "cinder-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:43:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:43:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381ef22-b330-449d-b05d-bbc864068690]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:44 devstack sudo[101844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:44 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:44 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.602s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:44 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d
Sep 29 16:43:44 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:45 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d" released by "delete_volume" :: held 1.156s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Created reservations ['16e07254-16c4-44b3-8e4c-9dbc44a2204b', 'e4aa4590-ef81-4018-a480-af5aa3c63354', '61fdeed7-26af-4892-8c34-425f0e18445a', '21de991c-b58c-4ecc-9fdd-38bf52923ace'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:45 devstack sudo[101894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:45 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:45 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:43:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43bbe4f7-4136-4214-bdb7-d77631d176f7 tempest-VolumesGetTest-1007308239 None] Lock "cinder-92ed5f09-c4f7-4163-ac2e-b5d4252abe2d-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (81393395-c361-4408-b832-2f3a86720c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fbe69-cd32-4a06-9409-30f99d38357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fbe69-cd32-4a06-9409-30f99d38357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1731590383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf48a6b-0417-4886-a29a-d6b82d9671aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:47Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ac4fef-894e-4eb5-a599-d02e5e92bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ac4fef-894e-4eb5-a599-d02e5e92bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81271248-d8e5-4fbd-95e5-2ce31bca7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81271248-d8e5-4fbd-95e5-2ce31bca7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abf48a6b-0417-4886-a29a-d6b82d9671aa', 'volume_name': 'volume-abf48a6b-0417-4886-a29a-d6b82d9671aa', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda995e0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeea3f18-acc6-4ff9-ac30-063e61aaef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeea3f18-acc6-4ff9-ac30-063e61aaef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ddb7db-be4b-4d21-940b-d1387e9de549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Volume abf48a6b-0417-4886-a29a-d6b82d9671aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abf48a6b-0417-4886-a29a-d6b82d9671aa', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda995e0>}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Trying to clone abf48a6b-0417-4886-a29a-d6b82d9671aa from image 5bde2f08-ba6c-4285-b385-cf604fce5707 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:43:47 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:43:47 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d1416-15e1-435d-bfa0-d3f8bbb898fc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:48 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD
Sep 29 16:43:48 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:48 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 is fetched for user 06d30afc7f55484984981a7d6940cb61. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9fc8a-bf49-4036-8011-84ed6cf4e100]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:48 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD
Sep 29 16:43:48 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:48 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1731590383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf48a6b-0417-4886-a29a-d6b82d9671aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:47Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Creating volume abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:43:48 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:43:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:48 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1073741824
Sep 29 16:43:48 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:49 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1073741824" returned: 0 in 0.509s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:49 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa
Sep 29 16:43:49 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:49 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa" returned: 0 in 0.253s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.482s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3847f6a-0cea-49c1-b8e0-cabfe808ee13]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Attempting download of 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume abf48a6b-0417-4886-a29a-d6b82d9671aa. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6b2d24-c266-40fc-9a74-0fa6191cb9cb]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:49 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:43:49 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:49 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20
Sep 29 16:43:49 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:50 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:50 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ddb3b-0f2f-4afe-bc78-b32167aead5e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20" returned: 0 in 0.385s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:50 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:43:50 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:50 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20
Sep 29 16:43:50 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:50 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20" returned: 1 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bde2f08-ba6c-4285-b385-cf604fce5707_ajqf0p20' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cac6b4-b3c1-4702-9ca0-23d8005688d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:50 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.424s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.6c24f5a5-dd0a-4525-9fe5-6b9220876dbfvyisczz1.img {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:50 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.6c24f5a5-dd0a-4525-9fe5-6b9220876dbfvyisczz1.img
Sep 29 16:43:50 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:50 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD
Sep 29 16:43:50 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:50 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] 5bde2f08-ba6c-4285-b385-cf604fce5707 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:43:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:51 devstack sudo[101961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa
Sep 29 16:43:51 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:43:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:53 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:43:53 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:54 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:43:54 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:43:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:43:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:43:56 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa" returned: 0 in 5.676s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:56 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bde2f08-ba6c-4285-b385-cf604fce5707_pm6jtvxtdevstack@QuobyteHD, size 112.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:43:56 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Converted 112.00 MB image at 19.73 MB/s
Sep 29 16:43:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:56 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1G
Sep 29 16:43:56 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:57 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa 1G" returned: 0 in 0.964s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Downloaded image 5bde2f08-ba6c-4285-b385-cf604fce5707 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}])) to volume abf48a6b-0417-4886-a29a-d6b82d9671aa successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Temporary image 5bde2f08-ba6c-4285-b385-cf604fce5707 for user 06d30afc7f55484984981a7d6940cb61 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Marking volume abf48a6b-0417-4886-a29a-d6b82d9671aa as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Copying metadata from image 5bde2f08-ba6c-4285-b385-cf604fce5707 to abf48a6b-0417-4886-a29a-d6b82d9671aa. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Creating volume glance metadata for volume abf48a6b-0417-4886-a29a-d6b82d9671aa backed by image 5bde2f08-ba6c-4285-b385-cf604fce5707 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ddb7db-be4b-4d21-940b-d1387e9de549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf48a6b-0417-4886-a29a-d6b82d9671aa', 'volume_size': 1, 'image_id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bde2f08-ba6c-4285-b385-cf604fce5707', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f79586b7ec48f7bf8d34b2d7bca662', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5bde2f08-ba6c-4285-b385-cf604fce5707', 'created_at': datetime.datetime(2026, 9, 29, 14, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 24, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bde2f08-ba6c-4285-b385-cf604fce5707/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda995e0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee2faed-39cd-4f8a-8370-737f9a57f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Volume volume-abf48a6b-0417-4886-a29a-d6b82d9671aa (abf48a6b-0417-4886-a29a-d6b82d9671aa): created successfully
Sep 29 16:43:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee2faed-39cd-4f8a-8370-737f9a57f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (81393395-c361-4408-b832-2f3a86720c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dc18f152-22e9-43e4-99ed-b600ec934472 tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:43:58 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.6c24f5a5-dd0a-4525-9fe5-6b9220876dbfvyisczz1.img" returned: 0 in 7.792s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108b0bf-865b-45db-a1c1-96e27c854e3b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:43:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:43:58 devstack sudo[101980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:43:58 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:43:59 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.780s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.6c24f5a5-dd0a-4525-9fe5-6b9220876dbfvyisczz1.img {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:43:59 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Converted 1024.00 MB image at 131.40 MB/s
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] 6c24f5a5-dd0a-4525-9fe5-6b9220876dbf was raw, no need to convert to raw {{(pid=86843) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (01c129c3-5163-4cf7-9a8b-01a89e67c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90145d05-640e-4b39-b139-8d5de6fca5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90145d05-640e-4b39-b139-8d5de6fca5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1755777388',display_name='tempest-VolumesGetTest-Volume-652291341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce6de0-e966-4eef-9c39-658622f2ae14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:59Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddfddef-0b5f-40a3-8c89-97b879e33f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddfddef-0b5f-40a3-8c89-97b879e33f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793de817-ff3d-4947-bff9-abef686423fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793de817-ff3d-4947-bff9-abef686423fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ce6de0-e966-4eef-9c39-658622f2ae14', 'volume_name': 'volume-f6ce6de0-e966-4eef-9c39-658622f2ae14', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dff8408-2fae-4890-a54e-2a606efcef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dff8408-2fae-4890-a54e-2a606efcef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc07a50-6038-4caa-87d4-02c600e141b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:43:59 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Volume f6ce6de0-e966-4eef-9c39-658622f2ae14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ce6de0-e966-4eef-9c39-658622f2ae14', 'volume_size': 1}
Sep 29 16:43:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:09 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=70,cinder:INSERT=34,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:44:09 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=93,cinder:INSERT=24,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.191s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Uploaded volume to glance image-id: 6c24f5a5-dd0a-4525-9fe5-6b9220876dbf. {{(pid=86843) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.570s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:43:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1755777388',display_name='tempest-VolumesGetTest-Volume-652291341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce6de0-e966-4eef-9c39-658622f2ae14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9072beb5cd604caeb28ea44f4858833e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:59Z,use_quota=True,user_id='06d30afc7f55484984981a7d6940cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Creating volume f6ce6de0-e966-4eef-9c39-658622f2ae14 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:19 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:19 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 1073741824
Sep 29 16:44:19 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-27ee6bed-c8f1-4950-8a1d-10886ee9c98e tempest-VolumesActionsTest-519560619 None] Copy volume to image completed successfully.
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:44:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Flow 'volume_create_manager' (b5feb91f-347c-4a00-9d52-b4e6d97a113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041a03bd-a2da-4349-8c47-f4638f087bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041a03bd-a2da-4349-8c47-f4638f087bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-595487019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d634e01-e737-4307-862a-b40e34f3c9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8c9e889bc345968fe0cc83f767f8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:20Z,use_quota=True,user_id='b1e005f97d314489ac52a175f3f7c1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe145b-99d4-498d-8f14-0418db5a8978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe145b-99d4-498d-8f14-0418db5a8978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2441d3b-fd59-4916-a352-f3fcd271c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2441d3b-fd59-4916-a352-f3fcd271c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d634e01-e737-4307-862a-b40e34f3c9aa', 'volume_name': 'volume-9d634e01-e737-4307-862a-b40e34f3c9aa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda627bf-f969-486c-b202-c43fff738a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda627bf-f969-486c-b202-c43fff738a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1e9874-6e2a-4dab-94ac-9028bc1b259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Volume 9d634e01-e737-4307-862a-b40e34f3c9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d634e01-e737-4307-862a-b40e34f3c9aa', 'volume_size': 1}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:20 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 1073741824" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:20 devstack sudo[101999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14
Sep 29 16:44:20 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:20 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-595487019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d634e01-e737-4307-862a-b40e34f3c9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8c9e889bc345968fe0cc83f767f8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:20Z,use_quota=True,user_id='b1e005f97d314489ac52a175f3f7c1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Creating volume 9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:20 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:20 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa 1073741824
Sep 29 16:44:20 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc07a50-6038-4caa-87d4-02c600e141b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ce6de0-e966-4eef-9c39-658622f2ae14', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1092a94-3ab4-421b-8bf1-7cd86b4867e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:20 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Volume volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 (f6ce6de0-e966-4eef-9c39-658622f2ae14): created successfully
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1092a94-3ab4-421b-8bf1-7cd86b4867e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:20 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Flow 'volume_create_manager' (01c129c3-5163-4cf7-9a8b-01a89e67c665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b277d44d-96b3-4418-937f-259ab486c3e6 tempest-VolumesGetTest-1007308239 None] Created volume successfully.
Sep 29 16:44:21 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa 1073741824" returned: 0 in 0.569s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:21 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:44:21 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:21 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1e9874-6e2a-4dab-94ac-9028bc1b259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d634e01-e737-4307-862a-b40e34f3c9aa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7c964-5aa3-4397-bec8-422ec82c1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Volume volume-9d634e01-e737-4307-862a-b40e34f3c9aa (9d634e01-e737-4307-862a-b40e34f3c9aa): created successfully
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7c964-5aa3-4397-bec8-422ec82c1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Flow 'volume_create_manager' (b5feb91f-347c-4a00-9d52-b4e6d97a113f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-538a0b50-04b5-440f-ab6d-a957f327762d tempest-TestStampPattern-163067589 None] Created volume successfully.
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d5e5b-2bc3-48a5-a601-2ccf44079e72]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-f6ce6de0-e966-4eef-9c39-658622f2ae14-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "cinder-f6ce6de0-e966-4eef-9c39-658622f2ae14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:22 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:44:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-f6ce6de0-e966-4eef-9c39-658622f2ae14" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-f6ce6de0-e966-4eef-9c39-658622f2ae14" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[047d0797-b39c-48b0-9f45-d892f0c7caea]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:22 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14
Sep 29 16:44:22 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:22 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.460s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad622e-6952-4a93-86ad-a27abf209589]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:22 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:44:22 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:22 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14" returned: 0 in 0.494s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:22 devstack sudo[102029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14
Sep 29 16:44:22 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:22 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:22 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img
Sep 29 16:44:22 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:23 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f6ce6de0-e966-4eef-9c39-658622f2ae14" returned: 0 in 0.372s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-f6ce6de0-e966-4eef-9c39-658622f2ae14" released by "delete_volume" :: held 0.946s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Created reservations ['70aaef51-37ed-4c1c-99e0-4940815dc459', 'f93391ce-6299-4095-b8c7-e2f9751550c5', '3a2d8afb-2ae1-4891-982e-2dc63b0f33b5', '5b6a2de9-73f5-4d73-8242-2a0b51bec280'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:23 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:23 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:23 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.448s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:44:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:44:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edb53646-b800-47c8-8b22-1859f181324e tempest-VolumesGetTest-1007308239 None] Lock "cinder-f6ce6de0-e966-4eef-9c39-658622f2ae14-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-abf48a6b-0417-4886-a29a-d6b82d9671aa-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "cinder-abf48a6b-0417-4886-a29a-d6b82d9671aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Acquiring lock "cinder-quobyte-abf48a6b-0417-4886-a29a-d6b82d9671aa" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-abf48a6b-0417-4886-a29a-d6b82d9671aa" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d0682-5546-4111-bf55-ea03da41d652]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:25 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa
Sep 29 16:44:25 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:25 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa" returned: 0 in 0.760s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:25 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa
Sep 29 16:44:25 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:26 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abf48a6b-0417-4886-a29a-d6b82d9671aa" returned: 0 in 0.583s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "cinder-quobyte-abf48a6b-0417-4886-a29a-d6b82d9671aa" released by "delete_volume" :: held 1.445s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Created reservations ['ab24213e-50e2-46ec-9ca6-c0c394d0e2a4', '768a3942-4a9f-4c1f-a661-d917286e9914', '03c34b36-3f0b-4a47-8bba-bcf79f5dd7f0', '1de851d4-8c60-48df-aaf6-8b0ed4a5667a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:26 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:26 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:27 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.548s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:27 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:44:27 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Deleted volume successfully.
Sep 29 16:44:27 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6927c7f3-bdf9-437e-85c9-0ccd4d84844f tempest-VolumesGetTest-1007308239 None] Lock "cinder-abf48a6b-0417-4886-a29a-d6b82d9671aa-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:32 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img" returned: 0 in 10.036s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe44b5f0-2cf0-4b6f-96a8-1a8598c1b367]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:33 devstack sudo[102163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:44:33 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:33 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.772s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:44:33 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Converted 1024.00 MB image at 102.03 MB/s
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] 8f281d0e-d542-4f71-95cb-7f205d4b5831 was raw, converting to qcow2 {{(pid=86843) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df4b90-6c83-42f3-ba78-db66d54b6f47]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:33 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img
Sep 29 16:44:33 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:34 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img" returned: 0 in 0.417s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:34 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img
Sep 29 16:44:34 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:34 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img" returned: 1 in 0.517s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:44:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:34 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy
Sep 29 16:44:34 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:35 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Image conversion details: src /opt/stack/data/cinder/conversion/8781ace1-fc17-45b0-8908-fe71c23182c8.temp_image.8f281d0e-d542-4f71-95cb-7f205d4b5831_kqvxdx1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:44:35 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d2188-5ad3-46dd-9d36-85d24d952efd]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:35 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy
Sep 29 16:44:35 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Flow 'volume_create_manager' (71280630-697c-442b-bbab-2334a34b6bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82446457-367a-4a05-9e57-290d1ad4aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82446457-367a-4a05-9e57-290d1ad4aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2109073219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62be466-46cd-4236-88ed-078b3c3bd31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069b1edf33224b1ab55e8ab15def7186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:35Z,use_quota=True,user_id='957f56d656724e84b8aa5fe7bfd9413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8b2b55-6c79-4381-a3e1-3b93464e8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8b2b55-6c79-4381-a3e1-3b93464e8373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02cb3de-dad6-4d55-add9-86b2b61d3bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02cb3de-dad6-4d55-add9-86b2b61d3bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62be466-46cd-4236-88ed-078b3c3bd31c', 'volume_name': 'volume-b62be466-46cd-4236-88ed-078b3c3bd31c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6735f0a2-e3e5-4883-a3c5-06a371af4b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6735f0a2-e3e5-4883-a3c5-06a371af4b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281ce39-e633-4eea-9c8e-dbf4379a5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Volume b62be466-46cd-4236-88ed-078b3c3bd31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62be466-46cd-4236-88ed-078b3c3bd31c', 'volume_size': 1}
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:35 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9qxjn_vy" returned: 0 in 0.398s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.096s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Uploaded volume to glance image-id: 8f281d0e-d542-4f71-95cb-7f205d4b5831. {{(pid=86843) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2109073219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62be466-46cd-4236-88ed-078b3c3bd31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069b1edf33224b1ab55e8ab15def7186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:35Z,use_quota=True,user_id='957f56d656724e84b8aa5fe7bfd9413e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Creating volume b62be466-46cd-4236-88ed-078b3c3bd31c {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:37 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:37 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c 1073741824
Sep 29 16:44:37 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d637c5d6-31c3-45b8-bfce-c6f7ef846720 tempest-VolumesActionsTest-519560619 None] Copy volume to image completed successfully.
Sep 29 16:44:37 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c 1073741824" returned: 0 in 0.533s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:37 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c
Sep 29 16:44:37 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:37 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281ce39-e633-4eea-9c8e-dbf4379a5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62be466-46cd-4236-88ed-078b3c3bd31c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965b49fb-acfe-4fa9-9742-a9e9fbee16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Volume volume-b62be466-46cd-4236-88ed-078b3c3bd31c (b62be466-46cd-4236-88ed-078b3c3bd31c): created successfully
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965b49fb-acfe-4fa9-9742-a9e9fbee16dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Flow 'volume_create_manager' (71280630-697c-442b-bbab-2334a34b6bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-45237e91-5265-4da6-917a-459a66cd6c88 tempest-VolumesNegativeTest-62405488 None] Created volume successfully.
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Acquiring lock "cinder-quobyte-8781ace1-fc17-45b0-8908-fe71c23182c8" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "cinder-quobyte-8781ace1-fc17-45b0-8908-fe71c23182c8" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a24662-c394-43d5-b703-c56735ad90a7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:38 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:44:38 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:39 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.468s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:39 devstack sudo[102208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8
Sep 29 16:44:39 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:39 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8781ace1-fc17-45b0-8908-fe71c23182c8" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "cinder-quobyte-8781ace1-fc17-45b0-8908-fe71c23182c8" released by "delete_volume" :: held 0.823s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Created reservations ['937053a0-4b9c-401e-9e45-5c5d665e439b', '3686b420-4bfc-4f60-b55b-e5a903f975bb', '1274fea0-7bdf-4f6f-bda8-c8d8e98efb0c', 'dce8b9bb-807d-4a1b-a123-bdc4bd13b93f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:39 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:39 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:40 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.328s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:40 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:44:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Deleted volume successfully.
Sep 29 16:44:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d4d5e41c-f1ba-4bdf-839b-abf32df82bf2 tempest-VolumesActionsTest-519560619 None] Lock "cinder-8781ace1-fc17-45b0-8908-fe71c23182c8-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (7fd49bce-461d-4975-bb8b-da7de3da5b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fcb0ab-517e-4ec2-b34e-f12ce8714a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fcb0ab-517e-4ec2-b34e-f12ce8714a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988327298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c7736-0b86-42dc-b7da-c1de52fe81fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:49Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e654278-d8c0-467e-890f-0131c7c252f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e654278-d8c0-467e-890f-0131c7c252f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466b6104-c0a5-47a3-8db8-16bcaaf2a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466b6104-c0a5-47a3-8db8-16bcaaf2a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3c7736-0b86-42dc-b7da-c1de52fe81fa', 'volume_name': 'volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19054a93-1a83-45db-8ad4-304c3e73db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19054a93-1a83-45db-8ad4-304c3e73db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba96afef-51cd-4dc4-8f81-9121729071f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Volume fd3c7736-0b86-42dc-b7da-c1de52fe81fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa', 'volume_size': 1}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988327298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c7736-0b86-42dc-b7da-c1de52fe81fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:49Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Creating volume fd3c7736-0b86-42dc-b7da-c1de52fe81fa {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:49 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:49 devstack sudo[102376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa 1073741824
Sep 29 16:44:49 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:49 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa 1073741824" returned: 0 in 0.596s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:50 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa
Sep 29 16:44:50 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:50 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" returned: 0 in 0.298s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba96afef-51cd-4dc4-8f81-9121729071f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0160c6b8-9d69-4cf3-8e8d-704626a8c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:50 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Volume volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa (fd3c7736-0b86-42dc-b7da-c1de52fe81fa): created successfully
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0160c6b8-9d69-4cf3-8e8d-704626a8c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (7fd49bce-461d-4975-bb8b-da7de3da5b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-04f7aa5e-b6fd-4850-98a4-065ff0e68890 tempest-VolumesListTestJSON-1125857900 None] Created volume successfully.
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (2ebd6e2a-3704-4cad-ba57-771e6f78356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a03fda-fd54-45fb-907c-d8c254fe42f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a03fda-fd54-45fb-907c-d8c254fe42f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977086345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fcb4cb-1dbb-4a71-a958-4f3042c9295d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:52Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ee4b3-3189-4f26-a3f6-646613566fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ee4b3-3189-4f26-a3f6-646613566fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb71affd-2545-439c-82f8-d8c3020d05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb71affd-2545-439c-82f8-d8c3020d05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fcb4cb-1dbb-4a71-a958-4f3042c9295d', 'volume_name': 'volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2c432f-8ece-4d93-8882-827519b5cb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2c432f-8ece-4d93-8882-827519b5cb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcaead0-1f02-4455-95ab-ea883fbf678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Volume e4fcb4cb-1dbb-4a71-a958-4f3042c9295d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d', 'volume_size': 1}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977086345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fcb4cb-1dbb-4a71-a958-4f3042c9295d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:52Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Creating volume e4fcb4cb-1dbb-4a71-a958-4f3042c9295d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:52 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:52 devstack sudo[102413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d 1073741824
Sep 29 16:44:52 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:52 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d 1073741824" returned: 0 in 0.498s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:52 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d
Sep 29 16:44:52 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:53 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" returned: 0 in 0.277s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcaead0-1f02-4455-95ab-ea883fbf678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4e651-292c-47e6-80c8-28ca320ee708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Volume volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d (e4fcb4cb-1dbb-4a71-a958-4f3042c9295d): created successfully
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc4e651-292c-47e6-80c8-28ca320ee708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (2ebd6e2a-3704-4cad-ba57-771e6f78356c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-97172635-1998-4c34-ba7b-e72236b98fbe tempest-VolumesListTestJSON-1125857900 None] Created volume successfully.
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:53 devstack sudo[102422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:53 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:53 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.292s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:44:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (b27bc3bd-4a6d-419d-ac04-27b661de19f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edffe52c-8761-4b84-b218-c32c557460a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edffe52c-8761-4b84-b218-c32c557460a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1364154751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3c74cc-fc0f-4362-be48-5b4077f05027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:55Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537b372d-d2f1-4ac7-abe9-e7d5fbefd4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537b372d-d2f1-4ac7-abe9-e7d5fbefd4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ab015-6291-44dd-a4db-9f8ee2fb45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ab015-6291-44dd-a4db-9f8ee2fb45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3c74cc-fc0f-4362-be48-5b4077f05027', 'volume_name': 'volume-ff3c74cc-fc0f-4362-be48-5b4077f05027', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9472b79d-2d77-4f00-9493-a8b1afedecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9472b79d-2d77-4f00-9493-a8b1afedecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cfadfe-03f1-42fd-a4ab-94fa7a9cc94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:54 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Volume ff3c74cc-fc0f-4362-be48-5b4077f05027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3c74cc-fc0f-4362-be48-5b4077f05027', 'volume_size': 1}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1364154751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3c74cc-fc0f-4362-be48-5b4077f05027,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='93ef633b6d3346bb94dd73a1ed4f16a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:55Z,use_quota=True,user_id='6bfa165a323d4e7399673350c8b93480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Creating volume ff3c74cc-fc0f-4362-be48-5b4077f05027 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:44:54 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:44:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:54 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 1073741824
Sep 29 16:44:54 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:55 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 1073741824" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:55 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027
Sep 29 16:44:55 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:55 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cfadfe-03f1-42fd-a4ab-94fa7a9cc94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3c74cc-fc0f-4362-be48-5b4077f05027', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb862b63-64ef-4485-b9b1-b96112490943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:44:55 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Volume volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 (ff3c74cc-fc0f-4362-be48-5b4077f05027): created successfully
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb862b63-64ef-4485-b9b1-b96112490943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:44:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Flow 'volume_create_manager' (b27bc3bd-4a6d-419d-ac04-27b661de19f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:44:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5b49c66c-01e9-4ef9-a426-c01022efb931 tempest-VolumesListTestJSON-1125857900 None] Created volume successfully.
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-619050ab-aa41-47d6-a8fe-6c039ba3600f req-1df3c891-f1b3-4a94-a82a-00a6f7210516 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-619050ab-aa41-47d6-a8fe-6c039ba3600f req-1df3c891-f1b3-4a94-a82a-00a6f7210516 tempest-TestStampPattern-163067589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-ff3c74cc-fc0f-4362-be48-5b4077f05027-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-619050ab-aa41-47d6-a8fe-6c039ba3600f req-1df3c891-f1b3-4a94-a82a-00a6f7210516 tempest-TestStampPattern-163067589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-ff3c74cc-fc0f-4362-be48-5b4077f05027-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-619050ab-aa41-47d6-a8fe-6c039ba3600f req-1df3c891-f1b3-4a94-a82a-00a6f7210516 tempest-TestStampPattern-163067589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-9d634e01-e737-4307-862a-b40e34f3c9aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1174b7a-35ee-4ef3-935d-36408a59273e', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-quobyte-ff3c74cc-fc0f-4362-be48-5b4077f05027" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-ff3c74cc-fc0f-4362-be48-5b4077f05027" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcdc927-2689-4f6c-a0a0-76be8b78a802]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-619050ab-aa41-47d6-a8fe-6c039ba3600f req-1df3c891-f1b3-4a94-a82a-00a6f7210516 tempest-TestStampPattern-163067589 None] attachment_update completed successfully.
Sep 29 16:44:58 devstack sudo[102451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027
Sep 29 16:44:58 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Acquiring lock "cinder-b62be466-46cd-4236-88ed-078b3c3bd31c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "cinder-b62be466-46cd-4236-88ed-078b3c3bd31c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Acquiring lock "cinder-quobyte-b62be466-46cd-4236-88ed-078b3c3bd31c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "cinder-quobyte-b62be466-46cd-4236-88ed-078b3c3bd31c" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:58 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027" returned: 0 in 0.519s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc368d8-076b-4f89-8bb8-c866dfdf18ac]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:58 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027
Sep 29 16:44:58 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:58 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c
Sep 29 16:44:58 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:59 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ff3c74cc-fc0f-4362-be48-5b4077f05027" returned: 0 in 0.303s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-ff3c74cc-fc0f-4362-be48-5b4077f05027" released by "delete_volume" :: held 0.885s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Created reservations ['f73eac66-31db-4496-b58e-241fc91fc41b', '7a9cfd02-9199-4c34-ac69-844db021b9ff', 'd78974be-be49-4302-91a8-6e242b063e77', 'abf78d7a-b745-46bf-9405-af0e156db2e0'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:44:59 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c" returned: 0 in 0.524s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:59 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:59 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:59 devstack sudo[102884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c
Sep 29 16:44:59 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-quobyte-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b947d1d-6b0b-4c43-af7b-4001a011bf56]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:59 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:59 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b62be466-46cd-4236-88ed-078b3c3bd31c" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "cinder-quobyte-b62be466-46cd-4236-88ed-078b3c3bd31c" released by "delete_volume" :: held 0.954s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Deleted volume successfully.
Sep 29 16:44:59 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d
Sep 29 16:44:59 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0ae7c9cc-8d35-49d5-b916-bce975380827 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-ff3c74cc-fc0f-4362-be48-5b4077f05027-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Created reservations ['3a29c963-5cae-4fff-9ba4-eab2bd379028', 'f58f8bd6-1e35-4ab8-9434-9c89ea429901', '584e65bd-de20-49a9-b614-65cfcc5f7d5c', '4bd1a28e-61c4-49da-9ac9-4f7fcd45861c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:44:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:44:59 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:44:59 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:00 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" returned: 0 in 0.405s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:00 devstack sudo[102899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d
Sep 29 16:45:00 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:00 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Deleted volume successfully.
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d6df4f0c-cb72-4c31-87bb-60ff639cd7be tempest-VolumesNegativeTest-62405488 None] Lock "cinder-b62be466-46cd-4236-88ed-078b3c3bd31c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:00 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d" released by "delete_volume" :: held 0.742s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Created reservations ['69fa121c-0c72-45f4-b7f0-cce5207bd894', '4f5e3687-f692-493c-8fc7-fdcf3a25de1d', '092f11e2-f9c5-4201-8be5-b76492bbd70b', 'c77cc242-a62b-4821-9c41-0cdd7f713b29'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:00 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:45:00 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-fd3c7736-0b86-42dc-b7da-c1de52fe81fa-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:00 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-fd3c7736-0b86-42dc-b7da-c1de52fe81fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Deleted volume successfully.
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "cinder-quobyte-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-82d44d8a-be6c-4b87-bd5f-02d8e7cda5ea tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-e4fcb4cb-1dbb-4a71-a958-4f3042c9295d-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4adeac-899a-4e6f-a14c-5670baf9d2db]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:00 devstack sudo[102914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa
Sep 29 16:45:00 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:01 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" returned: 0 in 0.451s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:01 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa
Sep 29 16:45:01 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:01 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-quobyte-fd3c7736-0b86-42dc-b7da-c1de52fe81fa" released by "delete_volume" :: held 0.790s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Created reservations ['ad3750c8-e5e9-45ea-a727-d01190d9e065', 'cad5650e-70cb-44c7-9dbd-6b5aafddc86b', '91083903-bbd8-471b-8a21-04f120771edc', '9178e574-9bf1-471c-a039-3d0b705f7db1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:01 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:45:01 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:02 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:02 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Deleted volume successfully.
Sep 29 16:45:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5f4c4804-8bf5-403b-8224-648488537304 tempest-VolumesListTestJSON-1125857900 None] Lock "cinder-fd3c7736-0b86-42dc-b7da-c1de52fe81fa-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-382f14dc-08bf-434d-9cf6-cb1938c738c2 req-97a11ec3-5692-49d5-878e-410eb4e756e9 tempest-TestStampPattern-163067589 None] Terminate volume connection completed successfully.
Sep 29 16:45:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-382f14dc-08bf-434d-9cf6-cb1938c738c2 req-97a11ec3-5692-49d5-878e-410eb4e756e9 tempest-TestStampPattern-163067589 None] Deleting attachment a1174b7a-35ee-4ef3-935d-36408a59273e. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:45:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Creating offline snapshot e685a140-456a-47ce-a3b6-e2e66ec45a47 of volume 9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:45:05 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac823f26-130f-448f-88bd-d9ccc53e05d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:05 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:45:05 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:06 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:06 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 1G
Sep 29 16:45:06 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:06 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 1G" returned: 0 in 0.599s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d634e01-e737-4307-862a-b40e34f3c9aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:06 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d634e01-e737-4307-862a-b40e34f3c9aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:45:06 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:07 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d634e01-e737-4307-862a-b40e34f3c9aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:07 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 is being set with open permissions: ugo+rw
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:07 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:45:07 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:07 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.303s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:07 devstack sudo[102991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info
Sep 29 16:45:07 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:07 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info" returned: 0 in 0.333s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:07 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info is being set with open permissions: ugo+rw
Sep 29 16:45:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:07 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info
Sep 29 16:45:07 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:08 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.info" returned: 0 in 0.331s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1801186c-1330-4ac6-a765-d5d75a98f91b tempest-TestStampPattern-163067589 None] Create snapshot completed successfully
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (5aeea71a-3fc7-4a3b-ab3e-209160c47158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf53463-4e30-48a6-b7da-d39f0a771804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf53463-4e30-48a6-b7da-d39f0a771804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1566135453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc87c56a-3ce7-4de4-8e7c-3961af4a67aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:16Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e3a177-d9e4-4224-b09f-6dc28377c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e3a177-d9e4-4224-b09f-6dc28377c125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c512c-7599-44a8-9c4b-f7c784e61a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19c512c-7599-44a8-9c4b-f7c784e61a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc87c56a-3ce7-4de4-8e7c-3961af4a67aa', 'volume_name': 'volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ab7f3-97fa-4164-ba87-88ed20e81a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ab7f3-97fa-4164-ba87-88ed20e81a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a48699-be80-4326-861d-685258df1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:15 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume bc87c56a-3ce7-4de4-8e7c-3961af4a67aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa', 'volume_size': 1}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1566135453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc87c56a-3ce7-4de4-8e7c-3961af4a67aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:16Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Creating volume bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:15 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:15 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa 1073741824
Sep 29 16:45:15 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:16 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa 1073741824" returned: 0 in 0.729s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:16 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa
Sep 29 16:45:16 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:16 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" returned: 0 in 0.327s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a48699-be80-4326-861d-685258df1b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53648b9-a942-4f40-a0a3-6fc08e225c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa (bc87c56a-3ce7-4de4-8e7c-3961af4a67aa): created successfully
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53648b9-a942-4f40-a0a3-6fc08e225c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (5aeea71a-3fc7-4a3b-ab3e-209160c47158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-be68a0c9-d0b7-4965-a847-754ab57fa036 tempest-VolumesSnapshotTestJSON-1449108985 None] Created volume successfully.
Sep 29 16:45:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Creating offline snapshot ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 of volume bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:45:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abe5b60-e248-433f-9769-934d3c4683c2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:18 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa
Sep 29 16:45:18 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:18 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Flow 'volume_create_manager' (d45510d7-a3f7-4505-9fc1-a4e06efc3127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d9aba-4c7b-4fca-8b6a-833119d31daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d9aba-4c7b-4fca-8b6a-833119d31daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1107576727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405e28e9-c907-4a2e-9423-855cb5fe95d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8c9e889bc345968fe0cc83f767f8eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e685a140-456a-47ce-a3b6-e2e66ec45a47,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:18Z,use_quota=True,user_id='b1e005f97d314489ac52a175f3f7c1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:18 devstack sudo[103050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 1G
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecc96d7-a450-4af0-95a3-2efd08051aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:18 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ecc96d7-a450-4af0-95a3-2efd08051aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2742437e-691d-4ef3-98fe-e165fba98225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2742437e-691d-4ef3-98fe-e165fba98225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '405e28e9-c907-4a2e-9423-855cb5fe95d4', 'volume_name': 'volume-405e28e9-c907-4a2e-9423-855cb5fe95d4', 'volume_size': 1, 'snapshot_id': 'e685a140-456a-47ce-a3b6-e2e66ec45a47'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32167e4f-ebc2-442e-902a-eb55d4b2b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32167e4f-ebc2-442e-902a-eb55d4b2b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d64942-b01d-4dc7-9674-72cb409bfa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Volume 405e28e9-c907-4a2e-9423-855cb5fe95d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-405e28e9-c907-4a2e-9423-855cb5fe95d4', 'volume_size': 1, 'snapshot_id': 'e685a140-456a-47ce-a3b6-e2e66ec45a47'}
Sep 29 16:45:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:19 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 1G" returned: 0 in 0.644s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:19 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8
Sep 29 16:45:19 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:19 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:19 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 is being set with open permissions: ugo+rw
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:19 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8
Sep 29 16:45:19 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:19 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=80,cinder:SELECT=62,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=68,cinder:UPDATE=83,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:45:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:19 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info
Sep 29 16:45:19 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:20 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info" returned: 0 in 0.366s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:20 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info is being set with open permissions: ugo+rw
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:20 devstack sudo[103069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info
Sep 29 16:45:20 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:20 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.info" returned: 0 in 0.354s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.060s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47-405e28e9-c907-4a2e-9423-855cb5fe95d4" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47-405e28e9-c907-4a2e-9423-855cb5fe95d4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Creating volume 405e28e9-c907-4a2e-9423-855cb5fe95d4 from snapshot e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] snapshot: e685a140-456a-47ce-a3b6-e2e66ec45a47, volume: 405e28e9-c907-4a2e-9423-855cb5fe95d4,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacb5f0-279b-47c7-8a60-89482497134f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e28e2f42-7223-48d9-aa88-1dcdf959ed5c tempest-VolumesSnapshotTestJSON-1449108985 None] Create snapshot completed successfully
Sep 29 16:45:20 devstack sudo[103072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:45:20 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:21 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.532s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d634e01-e737-4307-862a-b40e34f3c9aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a11c7-aa29-493b-b4b4-9c245092b0ba]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:21 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:45:21 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleting offline snapshot ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 of volume bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] snapshot_file for this snap is: volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499e844-b63e-45de-a04e-ce1b4b747b48]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:21 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8
Sep 29 16:45:21 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:21 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.728s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:22 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4
Sep 29 16:45:22 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:22 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" returned: 0 in 0.614s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340ace9-4574-4bca-a0f1-c42150d7f5ef]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:22 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa
Sep 29 16:45:22 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:22 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" returned: 0 in 0.680s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:23 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8
Sep 29 16:45:23 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:24 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" returned: 0 in 1.118s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:24 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8
Sep 29 16:45:24 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:24 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa.ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" returned: 0 in 0.675s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8" released by "_delete_snapshot" :: held 3.354s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" released by "delete_snapshot" :: held 3.394s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['9a421d30-7190-45ac-9ae2-2ee5bba0848d', '3521afb2-30da-4901-954f-9d1c01ee1b23', 'dd19fc45-dd8e-4cd6-9377-e097f4eb5b32', '0fb2ef9d-8263-491d-b2b7-2a1d2448eaab'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Delete snapshot completed successfully.
Sep 29 16:45:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7c366e45-7735-4cfb-97d5-e8f15f2b46a6 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-ae2dc2cb-06b0-42aa-89e5-a6fd9104a4b8-delete_snapshot" released by "delete_snapshot" :: held 3.835s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (205f4437-9367-4c58-a7ca-aa21c2f46af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135a1427-e3fd-461a-b112-326387cb96c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135a1427-e3fd-461a-b112-326387cb96c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1747104529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eacfa98-f76a-4f0f-9f55-918ac3194737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:27Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161ab04e-230a-431c-bcf7-bcd5dfbeac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161ab04e-230a-431c-bcf7-bcd5dfbeac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0cf81e-8005-4e44-b855-708eb99dfc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0cf81e-8005-4e44-b855-708eb99dfc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eacfa98-f76a-4f0f-9f55-918ac3194737', 'volume_name': 'volume-8eacfa98-f76a-4f0f-9f55-918ac3194737', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b3df84-ae96-4c11-b3d7-d809e3b2528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b3df84-ae96-4c11-b3d7-d809e3b2528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3794bf-643e-45c2-b548-456285a19d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:27 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume 8eacfa98-f76a-4f0f-9f55-918ac3194737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eacfa98-f76a-4f0f-9f55-918ac3194737', 'volume_size': 1}
Sep 29 16:45:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:33 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4" returned: 0 in 11.595s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa, size 1024.00 MB, duration 11.60 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:45:33 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Converted 1024.00 MB image at 88.30 MB/s
Sep 29 16:45:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 is being set with open permissions: ugo+rw
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:33 devstack sudo[103212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4
Sep 29 16:45:33 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:33 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4" returned: 0 in 0.278s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" released by "_copy_volume_from_snapshot" :: held 13.285s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47-405e28e9-c907-4a2e-9423-855cb5fe95d4" released by "_create_volume_from_snapshot" :: held 13.389s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.424s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.333s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1747104529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eacfa98-f76a-4f0f-9f55-918ac3194737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:27Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Creating volume 8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:33 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d64942-b01d-4dc7-9674-72cb409bfa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405e28e9-c907-4a2e-9423-855cb5fe95d4', 'volume_size': 1, 'snapshot_id': 'e685a140-456a-47ce-a3b6-e2e66ec45a47'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf54cfca-b3ba-47ea-acdf-6343d431c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:34 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 1073741824
Sep 29 16:45:34 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Volume volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 (405e28e9-c907-4a2e-9423-855cb5fe95d4): created successfully
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf54cfca-b3ba-47ea-acdf-6343d431c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Flow 'volume_create_manager' (d45510d7-a3f7-4505-9fc1-a4e06efc3127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3e6bf92e-53df-4352-a379-b70f1dd4e352 tempest-TestStampPattern-163067589 None] Created volume successfully.
Sep 29 16:45:34 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 1073741824" returned: 0 in 0.792s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:34 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:34 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:35 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.462s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3794bf-643e-45c2-b548-456285a19d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eacfa98-f76a-4f0f-9f55-918ac3194737', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fa898c-f461-4b70-98f1-fda84048c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Volume volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 (8eacfa98-f76a-4f0f-9f55-918ac3194737): created successfully
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fa898c-f461-4b70-98f1-fda84048c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (205f4437-9367-4c58-a7ca-aa21c2f46af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7e9bdf27-aa58-4545-9d83-115b99422e91 tempest-VolumesSnapshotTestJSON-1449108985 None] Created volume successfully.
Sep 29 16:45:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Creating offline snapshot 242b7f3e-68fa-49d1-9081-275db2ee9ecf of volume 8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:45:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca8443f-c8a9-4350-a3ba-9f6e87c89b59]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:36 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:36 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:37 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.501s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:37 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf 1G
Sep 29 16:45:37 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:37 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf 1G" returned: 0 in 0.783s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:38 devstack sudo[103236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:38 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:38 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.422s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:38 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf is being set with open permissions: ugo+rw
Sep 29 16:45:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:38 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:38 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:38 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.513s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:39 devstack sudo[103245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info
Sep 29 16:45:39 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:39 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:39 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info is being set with open permissions: ugo+rw
Sep 29 16:45:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:39 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info
Sep 29 16:45:39 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:39 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.info" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b94bd657-8657-4b5f-b0c5-fc176973b155 tempest-VolumesSnapshotTestJSON-1449108985 None] Create snapshot completed successfully
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (fccedfc8-afd3-42a8-8957-b6707e219d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5a04a0-e8e0-424a-9cd3-1792d767e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5a04a0-e8e0-424a-9cd3-1792d767e031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1093405482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=242b7f3e-68fa-49d1-9081-275db2ee9ecf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:41Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634b510-3fc6-4f90-991d-20c35663de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634b510-3fc6-4f90-991d-20c35663de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df671832-0a1e-4496-b975-9e46ea627bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df671832-0a1e-4496-b975-9e46ea627bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce', 'volume_name': 'volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce', 'volume_size': 2, 'snapshot_id': '242b7f3e-68fa-49d1-9081-275db2ee9ecf'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cac5f65-61c5-4199-83ca-beee696d2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cac5f65-61c5-4199-83ca-beee696d2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47591ee3-51b5-4493-a05f-8153acfa23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:41 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Volume b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce', 'volume_size': 2, 'snapshot_id': '242b7f3e-68fa-49d1-9081-275db2ee9ecf'}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Creating volume b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce from snapshot 242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] snapshot: 242b7f3e-68fa-49d1-9081-275db2ee9ecf, volume: b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[465b335c-cdc8-4127-991b-f238452a994d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:41 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:41 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:42 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.413s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eacfa98-f76a-4f0f-9f55-918ac3194737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[72547d53-1ba8-4584-b1b9-37107573d158]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:42 devstack sudo[103256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:42 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:42 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:45:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:42 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce
Sep 29 16:45:42 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (5b147025-d3c9-4acd-9445-8526589f5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd45b2d-e0c2-43a0-9753-3d3df186d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd45b2d-e0c2-43a0-9753-3d3df186d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1729845146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:45Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e122e55-38ee-49ef-8bdf-b743c3819096),volume_type_id=2e122e55-38ee-49ef-8bdf-b743c3819096)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f917bcb-3bd1-4430-9175-4c3b3b035e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f917bcb-3bd1-4430-9175-4c3b3b035e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719f811a-b73d-4dfd-9153-a2ee38cceb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719f811a-b73d-4dfd-9153-a2ee38cceb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2', 'volume_name': 'volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a101c5e5-8d2a-4e0e-aa1e-d32d0b4b51b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a101c5e5-8d2a-4e0e-aa1e-d32d0b4b51b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a416de9b-3a0b-4d63-9897-4c1d7397a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2', 'volume_size': 1}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (a196d09e-153a-4382-92b1-cfb2f912e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c230601-4ad0-45f7-8dc7-646411a809c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c230601-4ad0-45f7-8dc7-646411a809c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-146249383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3980dca-033e-4f63-9a23-08c61d34d7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:45Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2dab559-c491-48c4-9644-af63dce93348),volume_type_id=f2dab559-c491-48c4-9644-af63dce93348)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a6e36e-28f3-4553-8346-687714d5ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a6e36e-28f3-4553-8346-687714d5ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc669c3d-979b-4302-8c13-a6d1d6a2a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc669c3d-979b-4302-8c13-a6d1d6a2a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3980dca-033e-4f63-9a23-08c61d34d7b3', 'volume_name': 'volume-d3980dca-033e-4f63-9a23-08c61d34d7b3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3805d94a-4c0d-4e7b-8caa-3b21999d42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3805d94a-4c0d-4e7b-8caa-3b21999d42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8867e2a8-40e9-4a6f-9545-f1288420e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume d3980dca-033e-4f63-9a23-08c61d34d7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3980dca-033e-4f63-9a23-08c61d34d7b3', 'volume_size': 1}
Sep 29 16:45:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (50b5c07a-88d1-4c37-a3ae-2fc850827e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7426d7-746b-40d5-bf69-92a02ac543cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7426d7-746b-40d5-bf69-92a02ac543cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-490692217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9675700a-c84f-468a-8a6f-50823d02b641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:47Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7827f8fb-ff0d-4a9e-a727-92b88fa3c2a2),volume_type_id=7827f8fb-ff0d-4a9e-a727-92b88fa3c2a2)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a7ca2c-a6f1-4a12-ab3b-3109c8c84a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a7ca2c-a6f1-4a12-ab3b-3109c8c84a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b7eed-459b-4977-bba3-e49e832970ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:46 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:45:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336b7eed-459b-4977-bba3-e49e832970ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9675700a-c84f-468a-8a6f-50823d02b641', 'volume_name': 'volume-9675700a-c84f-468a-8a6f-50823d02b641', 'volume_size': 1, 'image_id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1559651022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7fa70e4d4734a14b8fd8bd1b6a6d5c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'created_at': datetime.datetime(2026, 9, 29, 14, 45, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 45, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda8bb00>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5f366b-4000-4098-87ae-9fc130b3cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5f366b-4000-4098-87ae-9fc130b3cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5c25b9-e6d9-4c9f-8b7d-a9bfc0f1d4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume 9675700a-c84f-468a-8a6f-50823d02b641: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9675700a-c84f-468a-8a6f-50823d02b641', 'volume_size': 1, 'image_id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1559651022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7fa70e4d4734a14b8fd8bd1b6a6d5c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'created_at': datetime.datetime(2026, 9, 29, 14, 45, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 45, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda8bb00>}
Sep 29 16:45:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Trying to clone 9675700a-c84f-468a-8a6f-50823d02b641 from image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:45:51 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" returned: 0 in 8.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:45:51 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Converted 1024.00 MB image at 122.59 MB/s
Sep 29 16:45:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce is being set with open permissions: ugo+rw
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:51 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce
Sep 29 16:45:51 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:51 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" released by "_copy_volume_from_snapshot" :: held 9.602s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" released by "_create_volume_from_snapshot" :: held 9.680s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.699s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.340s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1729845146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:45Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e122e55-38ee-49ef-8bdf-b743c3819096),volume_type_id=2e122e55-38ee-49ef-8bdf-b743c3819096)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Creating volume b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:51 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:51 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 1073741824
Sep 29 16:45:51 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47591ee3-51b5-4493-a05f-8153acfa23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce', 'volume_size': 2, 'snapshot_id': '242b7f3e-68fa-49d1-9081-275db2ee9ecf'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f7be34-beef-415a-a816-523c5a5405c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:51 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Volume volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce (b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce): created successfully
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f7be34-beef-415a-a816-523c5a5405c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (fccedfc8-afd3-42a8-8957-b6707e219d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ff464076-2b33-4e5c-90ab-2f3818514e8c tempest-VolumesSnapshotTestJSON-1449108985 None] Created volume successfully.
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715c6d1-20e7-4057-9751-1d013d21d10d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:51 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 1073741824" returned: 0 in 0.489s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:51 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce
Sep 29 16:45:51 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:51 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2
Sep 29 16:45:51 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" returned: 0 in 0.410s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:52 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:52 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce
Sep 29 16:45:52 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" returned: 0 in 0.290s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.504s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-146249383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3980dca-033e-4f63-9a23-08c61d34d7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:45Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2dab559-c491-48c4-9644-af63dce93348),volume_type_id=f2dab559-c491-48c4-9644-af63dce93348)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Creating volume d3980dca-033e-4f63-9a23-08c61d34d7b3 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:52 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a416de9b-3a0b-4d63-9897-4c1d7397a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:52 devstack sudo[103346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 1073741824
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd44d713-3d5a-4d23-be60-cfc107c1e38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:52 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 (b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2): created successfully
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd44d713-3d5a-4d23-be60-cfc107c1e38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (5b147025-d3c9-4acd-9445-8526589f5eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f49cb946-f233-4a29-a53d-98530c11bebd tempest-TestInstancesWithCinderVolumes-1526419312 None] Created volume successfully.
Sep 29 16:45:52 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" returned: 0 in 0.266s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce" released by "delete_volume" :: held 0.731s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['bce87e21-33c6-4ee9-8fe8-eb79980b2174', '4a30ffd8-1946-49bf-96b9-dca3eb10cf30', '274a7bc4-7280-4a82-8a6f-d1ade91a280c', '0b5662a8-99a1-4f69-be36-6dd81fbc1135'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:52 devstack sudo[103352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:45:52 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD, size 20.69 MB, duration 5.28 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:45:52 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Image download 20.69 MB at 3.92 MB/s
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 1073741824" returned: 0 in 0.489s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[903112e9-3a7a-4e5c-9f41-9ce322ae2d1b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:52 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3
Sep 29 16:45:52 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD
Sep 29 16:45:52 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:52 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-242b7f3e-68fa-49d1-9081-275db2ee9ecf-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Deleted volume successfully.
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-242b7f3e-68fa-49d1-9081-275db2ee9ecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-39a92901-1b49-4cbd-8b70-b9411573bc9d tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-b5a7f3cd-4c55-49de-ae52-bcd5ee0be3ce-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Deleting offline snapshot 242b7f3e-68fa-49d1-9081-275db2ee9ecf of volume 8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] snapshot_file for this snap is: volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d6fbd-c4bf-4bad-a899-b4b8b71f2d19]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:53 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3" returned: 0 in 0.346s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8867e2a8-40e9-4a6f-9545-f1288420e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3980dca-033e-4f63-9a23-08c61d34d7b3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:53 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831d9f56-ca45-462e-8140-78960a455453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Temporary image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 is fetched for user fc2f1931520344bbae3d0c36578a3817. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:45:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 (d3980dca-033e-4f63-9a23-08c61d34d7b3): created successfully
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831d9f56-ca45-462e-8140-78960a455453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (a196d09e-153a-4382-92b1-cfb2f912e263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cf9394c0-6480-4b8b-b340-432aa2ebcae6 tempest-TestInstancesWithCinderVolumes-1526419312 None] Created volume successfully.
Sep 29 16:45:53 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:53 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73052ba-8cb8-4c1b-b097-d8ebec45247e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:53 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD
Sep 29 16:45:53 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:53 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.400s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eacfa98-f76a-4f0f-9f55-918ac3194737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7896453-c0bf-425c-a7d8-927a051c3b1e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:53 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:45:53 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:53 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-490692217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9675700a-c84f-468a-8a6f-50823d02b641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7fa70e4d4734a14b8fd8bd1b6a6d5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:47Z,use_quota=True,user_id='fc2f1931520344bbae3d0c36578a3817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7827f8fb-ff0d-4a9e-a727-92b88fa3c2a2),volume_type_id=7827f8fb-ff0d-4a9e-a727-92b88fa3c2a2)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Creating volume 9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:53 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:53 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1073741824
Sep 29 16:45:53 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:53 devstack sudo[103371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:53 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:53 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.264s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:45:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:45:54 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1073741824" returned: 0 in 0.455s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.558s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:54 devstack sudo[103388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:54 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:54 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641
Sep 29 16:45:54 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:54 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Attempting download of fbd8a64b-222c-498f-ab55-8e8589ac7cf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}])) to volume 9675700a-c84f-468a-8a6f-50823d02b641. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:45:54 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.367s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f067cef-1376-4e3a-8eb2-7ac1874ae7c9]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:54 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf
Sep 29 16:45:54 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:54 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0
Sep 29 16:45:54 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:54 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737.242b7f3e-68fa-49d1-9081-275db2ee9ecf" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-242b7f3e-68fa-49d1-9081-275db2ee9ecf" released by "_delete_snapshot" :: held 1.710s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" released by "delete_snapshot" :: held 1.748s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:54 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0" returned: 0 in 0.347s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['ba60e12d-7418-41f4-934a-0da91767c5d7', 'e7c3fd59-cec5-4332-bd98-69c4337e798c', '6ead001f-bf9f-483a-bbd0-b35d292432a6', '64c9e728-4b24-406c-8bb4-d318bbf47788'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Delete snapshot completed successfully.
Sep 29 16:45:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6e1a9473-82ea-463d-ae45-4ce9b496580f tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-242b7f3e-68fa-49d1-9081-275db2ee9ecf-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:54 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0
Sep 29 16:45:54 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:55 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0" returned: 1 in 0.343s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9ch8mo0' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd719ba7-f115-4c8d-b7bc-73529de07590]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-8eacfa98-f76a-4f0f-9f55-918ac3194737-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-8eacfa98-f76a-4f0f-9f55-918ac3194737-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:55 devstack sudo[103408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD
Sep 29 16:45:55 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d16f24e-067c-40d3-9cd7-4994376a7e8c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:55 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:55 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:55 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] fbd8a64b-222c-498f-ab55-8e8589ac7cf4 was qcow2, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:55 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641
Sep 29 16:45:55 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:55 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:55 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737
Sep 29 16:45:55 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:56 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8eacfa98-f76a-4f0f-9f55-918ac3194737" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-8eacfa98-f76a-4f0f-9f55-918ac3194737" released by "delete_volume" :: held 0.711s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['fecd902d-5492-4676-8626-d9e863ba52d4', '606457f2-8f73-40db-b5a8-28f308fa6f07', '105da864-2a2b-46d7-82aa-6e1e0e1c4e80', '9c0353f3-987d-4e58-8a9a-2165c3e64a68'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:56 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:45:56 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:56 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:45:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleted volume successfully.
Sep 29 16:45:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-140ac4f4-de6f-48da-a09c-8bcca1ee1b52 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-8eacfa98-f76a-4f0f-9f55-918ac3194737-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (3d0c90ca-dd61-44ab-a987-3f3707c71477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b05a79d-9d44-460a-8129-de736998eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b05a79d-9d44-460a-8129-de736998eef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1324148841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f202e9a-d777-44b6-bd52-75535b0aca9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:57Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b02a53-9851-40e6-b90a-0e6e04b40d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b02a53-9851-40e6-b90a-0e6e04b40d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecf958d-7f1e-4183-ae3e-589cb82e4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecf958d-7f1e-4183-ae3e-589cb82e4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f202e9a-d777-44b6-bd52-75535b0aca9a', 'volume_name': 'volume-2f202e9a-d777-44b6-bd52-75535b0aca9a', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce16e76-eb75-4688-bc08-b09f3dce39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce16e76-eb75-4688-bc08-b09f3dce39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c1c9a2-c246-4de0-b737-ecf132828ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Volume 2f202e9a-d777-44b6-bd52-75535b0aca9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f202e9a-d777-44b6-bd52-75535b0aca9a', 'volume_size': 1}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1324148841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f202e9a-d777-44b6-bd52-75535b0aca9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:57Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Creating volume 2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:57 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a 1073741824
Sep 29 16:45:57 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:57 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641" returned: 0 in 1.937s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbd8a64b-222c-498f-ab55-8e8589ac7cf4_f9iqt2cmdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Converted 112.00 MB image at 57.79 MB/s
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:57 devstack sudo[103440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1G
Sep 29 16:45:57 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:57 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a 1073741824" returned: 0 in 0.481s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:57 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:45:57 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:57 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 1G" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Downloaded image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}])) to volume 9675700a-c84f-468a-8a6f-50823d02b641 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Temporary image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 for user fc2f1931520344bbae3d0c36578a3817 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Marking volume 9675700a-c84f-468a-8a6f-50823d02b641 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Copying metadata from image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 to 9675700a-c84f-468a-8a6f-50823d02b641. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Creating volume glance metadata for volume 9675700a-c84f-468a-8a6f-50823d02b641 backed by image fbd8a64b-222c-498f-ab55-8e8589ac7cf4 with: {'image_id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'image_name': 'tempest-scenario-img--1559651022', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5c25b9-e6d9-4c9f-8b7d-a9bfc0f1d4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9675700a-c84f-468a-8a6f-50823d02b641', 'volume_size': 1, 'image_id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1559651022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7fa70e4d4734a14b8fd8bd1b6a6d5c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd8a64b-222c-498f-ab55-8e8589ac7cf4', 'created_at': datetime.datetime(2026, 9, 29, 14, 45, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 45, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd8a64b-222c-498f-ab55-8e8589ac7cf4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560eda8bb00>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac58360-3d02-4ac0-be17-14dbe84b362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.267s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Volume volume-9675700a-c84f-468a-8a6f-50823d02b641 (9675700a-c84f-468a-8a6f-50823d02b641): created successfully
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac58360-3d02-4ac0-be17-14dbe84b362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Flow 'volume_create_manager' (50b5c07a-88d1-4c37-a3ae-2fc850827e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c1c9a2-c246-4de0-b737-ecf132828ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f202e9a-d777-44b6-bd52-75535b0aca9a', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177c86f9-6cb2-4994-b71e-d300324763d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2e9e1e03-7fe7-4535-92cd-8415e348bda0 tempest-TestInstancesWithCinderVolumes-1526419312 None] Created volume successfully.
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Volume volume-2f202e9a-d777-44b6-bd52-75535b0aca9a (2f202e9a-d777-44b6-bd52-75535b0aca9a): created successfully
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177c86f9-6cb2-4994-b71e-d300324763d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:45:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (3d0c90ca-dd61-44ab-a987-3f3707c71477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:45:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-62174431-6206-40b3-945a-5759b35ba95e tempest-VolumesSnapshotTestJSON-1449108985 None] Created volume successfully.
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Creating offline snapshot d91aef8c-5539-4ca2-8797-6ee9118af4ca of volume 2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fea52-aeec-4192-a76e-3708712acc6a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:59 devstack sudo[103448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:45:59 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:45:59 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:45:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:45:59 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca 1G
Sep 29 16:45:59 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:00 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca 1G" returned: 0 in 0.446s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f202e9a-d777-44b6-bd52-75535b0aca9a -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:00 devstack sudo[103462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f202e9a-d777-44b6-bd52-75535b0aca9a -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:00 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:00 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f202e9a-d777-44b6-bd52-75535b0aca9a -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca is being set with open permissions: ugo+rw
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:00 devstack sudo[103467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:00 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:00 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.270s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:00 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info
Sep 29 16:46:00 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:01 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info" returned: 0 in 0.286s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:01 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info is being set with open permissions: ugo+rw
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:01 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info
Sep 29 16:46:01 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ed1fbe28-7baf-48ed-b573-b290b0417281 req-ecc48c96-3f54-4e62-883f-cf8aae197dab tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:01 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.info" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ed1fbe28-7baf-48ed-b573-b290b0417281 req-ecc48c96-3f54-4e62-883f-cf8aae197dab tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.194s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-ed1fbe28-7baf-48ed-b573-b290b0417281 req-ecc48c96-3f54-4e62-883f-cf8aae197dab tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a1acf8d1-2215-486a-a198-6dcb1a38c0b8 tempest-VolumesSnapshotTestJSON-1449108985 None] Create snapshot completed successfully
Sep 29 16:46:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-ed1fbe28-7baf-48ed-b573-b290b0417281 req-ecc48c96-3f54-4e62-883f-cf8aae197dab tempest-TestInstancesWithCinderVolumes-1526419312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-9675700a-c84f-468a-8a6f-50823d02b641', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46896443-b5b5-4fd6-b9c4-6fc060510aa2', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:46:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-ed1fbe28-7baf-48ed-b573-b290b0417281 req-ecc48c96-3f54-4e62-883f-cf8aae197dab tempest-TestInstancesWithCinderVolumes-1526419312 None] attachment_update completed successfully.
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (a4fc8772-7ebc-4e62-a2a8-03513fc3df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644b3462-f3a8-4c26-8a7d-df7b985a64ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644b3462-f3a8-4c26-8a7d-df7b985a64ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-633271542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e603578-ee6e-4816-97fe-1bc001c065da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92a2417238845bca7061de7087a560e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d91aef8c-5539-4ca2-8797-6ee9118af4ca,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:03Z,use_quota=True,user_id='800340f46eec49478b97ee2faa1da119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b06218-5659-4857-83bf-aecc280d962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b06218-5659-4857-83bf-aecc280d962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750612a2-bc0f-46ae-968f-5ad9c2280d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750612a2-bc0f-46ae-968f-5ad9c2280d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e603578-ee6e-4816-97fe-1bc001c065da', 'volume_name': 'volume-2e603578-ee6e-4816-97fe-1bc001c065da', 'volume_size': 1, 'snapshot_id': 'd91aef8c-5539-4ca2-8797-6ee9118af4ca'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db5440c-646e-4caf-b3f8-b47e06a46693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db5440c-646e-4caf-b3f8-b47e06a46693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9035e18-00e1-4bdb-a805-7128193b2779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Volume 2e603578-ee6e-4816-97fe-1bc001c065da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e603578-ee6e-4816-97fe-1bc001c065da', 'volume_size': 1, 'snapshot_id': 'd91aef8c-5539-4ca2-8797-6ee9118af4ca'}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca-2e603578-ee6e-4816-97fe-1bc001c065da" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca-2e603578-ee6e-4816-97fe-1bc001c065da" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Creating volume 2e603578-ee6e-4816-97fe-1bc001c065da from snapshot d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] snapshot: d91aef8c-5539-4ca2-8797-6ee9118af4ca, volume: 2e603578-ee6e-4816-97fe-1bc001c065da,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[931d6562-acbf-496e-a773-cc1c082bb0d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:03 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:03 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:03 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.612s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f202e9a-d777-44b6-bd52-75535b0aca9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266d785-daee-4c12-823a-1bdc8ebbdfd8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:04 devstack sudo[103606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:46:04 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:04 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.610s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:46:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:46:04 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:46:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:04 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da
Sep 29 16:46:04 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:13 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da" returned: 0 in 8.545s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:46:13 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Converted 1024.00 MB image at 119.82 MB/s
Sep 29 16:46:13 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da is being set with open permissions: ugo+rw
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:13 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da
Sep 29 16:46:13 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=66,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=7 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=65,cinder:UPDATE=53,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:46:13 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da" returned: 0 in 0.344s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" released by "_copy_volume_from_snapshot" :: held 10.243s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca-2e603578-ee6e-4816-97fe-1bc001c065da" released by "_create_volume_from_snapshot" :: held 10.331s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.349s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9035e18-00e1-4bdb-a805-7128193b2779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e603578-ee6e-4816-97fe-1bc001c065da', 'volume_size': 1, 'snapshot_id': 'd91aef8c-5539-4ca2-8797-6ee9118af4ca'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed84820-00b7-4a9b-ad1e-d54483acd517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:13 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Volume volume-2e603578-ee6e-4816-97fe-1bc001c065da (2e603578-ee6e-4816-97fe-1bc001c065da): created successfully
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed84820-00b7-4a9b-ad1e-d54483acd517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:13 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Flow 'volume_create_manager' (a4fc8772-7ebc-4e62-a2a8-03513fc3df41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:13 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-13d3fb05-e734-49a4-a7a5-4e60f22517fd tempest-VolumesSnapshotTestJSON-1449108985 None] Created volume successfully.
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-2e603578-ee6e-4816-97fe-1bc001c065da-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-2e603578-ee6e-4816-97fe-1bc001c065da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2465d4-c6e3-47f1-9ff6-afbfc9540772]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:15 devstack sudo[104022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da
Sep 29 16:46:15 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e1bd6f40-58b9-4d31-a4ae-93afe69216d9 req-deed5d67-be8c-48cb-a767-4899ef3a096f tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e1bd6f40-58b9-4d31-a4ae-93afe69216d9 req-deed5d67-be8c-48cb-a767-4899ef3a096f tempest-TestStampPattern-163067589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-e1bd6f40-58b9-4d31-a4ae-93afe69216d9 req-deed5d67-be8c-48cb-a767-4899ef3a096f tempest-TestStampPattern-163067589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-e1bd6f40-58b9-4d31-a4ae-93afe69216d9 req-deed5d67-be8c-48cb-a767-4899ef3a096f tempest-TestStampPattern-163067589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-405e28e9-c907-4a2e-9423-855cb5fe95d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ebf3038-e3bb-4685-80f0-72bb1470253b', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:46:15 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da" returned: 0 in 0.833s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:15 devstack sudo[104035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da
Sep 29 16:46:15 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-e1bd6f40-58b9-4d31-a4ae-93afe69216d9 req-deed5d67-be8c-48cb-a767-4899ef3a096f tempest-TestStampPattern-163067589 None] attachment_update completed successfully.
Sep 29 16:46:16 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e603578-ee6e-4816-97fe-1bc001c065da" returned: 0 in 0.448s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2e603578-ee6e-4816-97fe-1bc001c065da" released by "delete_volume" :: held 1.373s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['d042ae94-61d3-4a69-be25-4367be876695', '8a0e0fd4-6125-4edd-adbe-a89b975725fa', '56d5313a-463b-484f-acd3-004658e84ff7', 'ba25e411-e961-41a3-b3ec-3634b07d4293'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:16 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:16 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:16 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.443s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleted volume successfully.
Sep 29 16:46:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-921375e7-5395-415b-8a55-817b267df090 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-2e603578-ee6e-4816-97fe-1bc001c065da-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-d91aef8c-5539-4ca2-8797-6ee9118af4ca-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-d91aef8c-5539-4ca2-8797-6ee9118af4ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleting offline snapshot d91aef8c-5539-4ca2-8797-6ee9118af4ca of volume 2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] snapshot_file for this snap is: volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad05cc-3fb6-40f2-b29a-4738ecf66d63]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:17 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:17 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:17 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.562s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f202e9a-d777-44b6-bd52-75535b0aca9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:18 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[63defe3e-35ed-4217-bc0c-910c812dbfdf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:18 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:46:18 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:18 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.768s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:18 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:18 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:19 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.518s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:19 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca
Sep 29 16:46:19 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:19 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a.d91aef8c-5539-4ca2-8797-6ee9118af4ca" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-d91aef8c-5539-4ca2-8797-6ee9118af4ca" released by "_delete_snapshot" :: held 2.523s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" released by "delete_snapshot" :: held 2.568s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-54cc9f52-4f2a-4c6c-9562-e7a18ccc03a3 req-8f0a28dc-b8cf-45ad-8228-edbed8b8a406 tempest-TestStampPattern-163067589 None] Terminate volume connection completed successfully.
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-54cc9f52-4f2a-4c6c-9562-e7a18ccc03a3 req-8f0a28dc-b8cf-45ad-8228-edbed8b8a406 tempest-TestStampPattern-163067589 None] Deleting attachment 5ebf3038-e3bb-4685-80f0-72bb1470253b. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:46:19 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['ce360c5f-8052-4ac8-a21b-3d14ab2e7706', '54a0f672-53da-4795-b5bd-2123e3aaf4f3', '08c751cf-bc52-42cd-9840-1c6457b6b643', 'da14955a-8ab4-4792-ae31-c27e95a46e2c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Delete snapshot completed successfully.
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b5e06109-d8da-46b1-8650-6b988259bb04 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-d91aef8c-5539-4ca2-8797-6ee9118af4ca-delete_snapshot" released by "delete_snapshot" :: held 2.785s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-2f202e9a-d777-44b6-bd52-75535b0aca9a-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-2f202e9a-d777-44b6-bd52-75535b0aca9a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f2f59d-3812-4669-aa2d-e3674ea4537a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:20 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:46:20 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:21 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.529s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:21 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a
Sep 29 16:46:21 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:21 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2f202e9a-d777-44b6-bd52-75535b0aca9a" returned: 0 in 0.567s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-2f202e9a-d777-44b6-bd52-75535b0aca9a" released by "delete_volume" :: held 1.182s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['b4aa41be-15b1-43fc-aa30-92e1123c2ef7', '988ed47f-1f38-4883-8a41-f47199ca36dd', '2ade3300-3567-43e0-9c97-599683c0ee8e', 'fbe0aa5d-6987-4664-b2ca-e3c83b6e4246'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:22 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:22 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:22 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:22 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleted volume successfully.
Sep 29 16:46:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f40a36ed-fbe1-4bfc-8247-d2704275e8d4 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-2f202e9a-d777-44b6-bd52-75535b0aca9a-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ea754-8ffb-4c29-ab19-6ca16b3a9179]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:23 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa
Sep 29 16:46:23 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:23 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" returned: 0 in 0.509s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:23 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa
Sep 29 16:46:23 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:24 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" returned: 0 in 0.298s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-quobyte-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa" released by "delete_volume" :: held 0.897s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Created reservations ['191efbb9-9a52-4225-822d-22bb393b4cae', 'ff5b2fb0-9b09-4e74-a476-892ccbc230a3', '3dec6c69-7885-42bc-97e0-567171081eac', 'b2426a0a-fee2-41ad-88c6-0e10e2e20028'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:24 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:24 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:24 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-405e28e9-c907-4a2e-9423-855cb5fe95d4-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.316s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Deleted volume successfully.
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "cinder-405e28e9-c907-4a2e-9423-855cb5fe95d4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3193f596-7191-40ca-97ab-17d568170554 tempest-VolumesSnapshotTestJSON-1449108985 None] Lock "cinder-bc87c56a-3ce7-4de4-8e7c-3961af4a67aa-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdfe00-564b-4ef5-b741-0cc1cf978167]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:24 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4
Sep 29 16:46:24 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:25 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4" returned: 0 in 0.491s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:25 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4
Sep 29 16:46:25 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:25 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-405e28e9-c907-4a2e-9423-855cb5fe95d4" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-405e28e9-c907-4a2e-9423-855cb5fe95d4" released by "delete_volume" :: held 0.881s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Created reservations ['d4714ce5-7723-46c3-b949-b5198174a70a', '0784f500-5e82-48a3-afae-9cd3705e248c', 'd80063d8-b196-4c46-a6ec-6b4581c86c4f', '8f2ab0de-7fb1-438c-b2a6-23b145b3c6cd'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:25 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:25 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:26 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Deleted volume successfully.
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd78f68f-ed5a-4249-a045-e9e5a2e52ce2 tempest-TestStampPattern-163067589 None] Lock "cinder-405e28e9-c907-4a2e-9423-855cb5fe95d4-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-e685a140-456a-47ce-a3b6-e2e66ec45a47-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-e685a140-456a-47ce-a3b6-e2e66ec45a47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Deleting offline snapshot e685a140-456a-47ce-a3b6-e2e66ec45a47 of volume 9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] snapshot_file for this snap is: volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64962c8-e016-4c1c-b7ea-579f02a2fc67]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:26 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:46:26 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:26 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.443s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d634e01-e737-4307-862a-b40e34f3c9aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046a1c0-a95d-4bc6-9099-6c7e3278aaa8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:26 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:46:26 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:27 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.576s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:27 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:46:27 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:27 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:27 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47
Sep 29 16:46:27 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:28 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa.e685a140-456a-47ce-a3b6-e2e66ec45a47" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-e685a140-456a-47ce-a3b6-e2e66ec45a47" released by "_delete_snapshot" :: held 1.950s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" released by "delete_snapshot" :: held 2.004s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:28 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Created reservations ['68e5ec7b-91f3-4dfa-b87b-a97eab3c8d35', 'a5d74e88-60e7-4a0d-88ac-b14bd3c64d9b', 'e8f55ffe-bd8c-4b99-9462-bbcd80027cf8', '6dd48d62-5782-44e7-acac-ae2b884efb88'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Delete snapshot completed successfully.
Sep 29 16:46:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e78ece34-af7b-4b7b-a40e-09f963912fc5 tempest-TestStampPattern-163067589 None] Lock "cinder-e685a140-456a-47ce-a3b6-e2e66ec45a47-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-9d634e01-e737-4307-862a-b40e34f3c9aa-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "cinder-9d634e01-e737-4307-862a-b40e34f3c9aa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Acquiring lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" acquired by "delete_volume" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ac316-8746-4163-a942-a1d5271bea86]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:33 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:46:33 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:33 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.451s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:33 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa
Sep 29 16:46:33 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:33 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9d634e01-e737-4307-862a-b40e34f3c9aa" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "cinder-quobyte-9d634e01-e737-4307-862a-b40e34f3c9aa" released by "delete_volume" :: held 0.813s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:33 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Created reservations ['19b4c777-0b06-46e2-93d0-1799e3b68ca5', '3e0cc1fe-c29d-4047-b479-be606eea1ee9', 'cb7c7f10-7c48-4a2e-ba4c-6b47199883fd', 'c3bcd6ad-97e2-4d89-81a4-4e5b9e7c8c05'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:34 devstack sudo[104255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:34 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:34 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Deleted volume successfully.
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-61476c01-127e-4e6d-bc02-bd6df5fec7a2 tempest-TestStampPattern-163067589 None] Lock "cinder-9d634e01-e737-4307-862a-b40e34f3c9aa-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Flow 'volume_create_manager' (d9dd63e5-cb15-4cfb-ac4c-8b98c7933433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c494fbc6-1729-4704-bd95-e81fd935ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c494fbc6-1729-4704-bd95-e81fd935ac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1351563823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c617534-8d8c-4624-a6d9-a20eca71580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a224b3cc3a4cb695dfea19ad7c4310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:34Z,use_quota=True,user_id='5b74992982854d9b96f57d4bd2208460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14309ce-ceba-4809-b4ab-3dcd6183f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14309ce-ceba-4809-b4ab-3dcd6183f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20a5a31-807c-4cc9-93ab-cd5a0481de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20a5a31-807c-4cc9-93ab-cd5a0481de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c617534-8d8c-4624-a6d9-a20eca71580e', 'volume_name': 'volume-5c617534-8d8c-4624-a6d9-a20eca71580e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316f8912-bf37-43a3-a80e-f53460519a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316f8912-bf37-43a3-a80e-f53460519a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11a998-7d50-40af-a4df-46c0626fbbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Volume 5c617534-8d8c-4624-a6d9-a20eca71580e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c617534-8d8c-4624-a6d9-a20eca71580e', 'volume_size': 1}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1351563823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c617534-8d8c-4624-a6d9-a20eca71580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a224b3cc3a4cb695dfea19ad7c4310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:34Z,use_quota=True,user_id='5b74992982854d9b96f57d4bd2208460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Creating volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:46:34 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:46:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:34 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e 1073741824
Sep 29 16:46:34 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:35 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e 1073741824" returned: 0 in 0.522s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:35 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e
Sep 29 16:46:35 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:35 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11a998-7d50-40af-a4df-46c0626fbbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c617534-8d8c-4624-a6d9-a20eca71580e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c10d288-ac9f-46b3-bc74-831bb68bb099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Volume volume-5c617534-8d8c-4624-a6d9-a20eca71580e (5c617534-8d8c-4624-a6d9-a20eca71580e): created successfully
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c10d288-ac9f-46b3-bc74-831bb68bb099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Flow 'volume_create_manager' (d9dd63e5-cb15-4cfb-ac4c-8b98c7933433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-77aadf2c-350a-4aa4-bcd5-5d640f5d46ef tempest-VolumesSnapshotListTestJSON-1722936526 None] Created volume successfully.
Sep 29 16:46:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Creating offline snapshot 77c2e72f-d765-4401-80cd-39d2c903163b of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:46:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59083a-2c17-47df-b121-15c594c6b3d6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:36 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e
Sep 29 16:46:36 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:37 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:37 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b 1G
Sep 29 16:46:37 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:37 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b 1G" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:37 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:37 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:37 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:37 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b is being set with open permissions: ugo+rw
Sep 29 16:46:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:37 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:37 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:38 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:38 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info
Sep 29 16:46:38 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:38 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info" returned: 0 in 0.331s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:38 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info is being set with open permissions: ugo+rw
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:38 devstack sudo[104299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info
Sep 29 16:46:38 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:38 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.info" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-033caf9b-fda9-43bb-b83f-e04de6bdc4b5 tempest-VolumesSnapshotListTestJSON-1722936526 None] Create snapshot completed successfully
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Creating offline snapshot e02313ed-48d4-42c1-9c8c-69db66176037 of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b66d9c-1ab1-4ca6-a89c-bdfb5938af10]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:40 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:40 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:40 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:40 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 1G
Sep 29 16:46:40 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-da8ee52f-cb0d-4984-9987-b4bad410a357 req-8f6e83ec-5d30-4fa2-8724-1768ca5c08cc tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:41 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 1G" returned: 0 in 0.499s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:41 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:41 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:41 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:41 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 is being set with open permissions: ugo+rw
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:41 devstack sudo[104335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:41 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:41 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-da8ee52f-cb0d-4984-9987-b4bad410a357 req-8f6e83ec-5d30-4fa2-8724-1768ca5c08cc tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.060s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-da8ee52f-cb0d-4984-9987-b4bad410a357 req-8f6e83ec-5d30-4fa2-8724-1768ca5c08cc tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-aee04eae-d490-42cc-bbea-2d1cbc5a6a13 tempest-VolumesSnapshotListTestJSON-1722936526 None] Create snapshot completed successfully
Sep 29 16:46:41 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-da8ee52f-cb0d-4984-9987-b4bad410a357 req-8f6e83ec-5d30-4fa2-8724-1768ca5c08cc tempest-TestInstancesWithCinderVolumes-1526419312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ea6fea0-ea23-47a0-8e26-bc6761300a0c', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:46:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-da8ee52f-cb0d-4984-9987-b4bad410a357 req-8f6e83ec-5d30-4fa2-8724-1768ca5c08cc tempest-TestInstancesWithCinderVolumes-1526419312 None] attachment_update completed successfully.
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Creating offline snapshot 0455fa13-20c8-49f8-8e45-6fab44f66451 of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bc84b-b2e3-44e7-9d3d-a86c3c909da9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:42 devstack sudo[104343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:42 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:42 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:42 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 1G
Sep 29 16:46:42 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:43 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 1G" returned: 0 in 0.624s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:43 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451
Sep 29 16:46:43 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:43 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:43 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 is being set with open permissions: ugo+rw
Sep 29 16:46:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:43 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451
Sep 29 16:46:43 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4ead0ef8-14d5-4d0d-a243-1babdd0007ba req-3883ce9e-e257-4383-b8f5-7bab214bfb5d tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:44 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4ead0ef8-14d5-4d0d-a243-1babdd0007ba req-3883ce9e-e257-4383-b8f5-7bab214bfb5d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.193s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-4ead0ef8-14d5-4d0d-a243-1babdd0007ba req-3883ce9e-e257-4383-b8f5-7bab214bfb5d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bad83e37-5b41-4daf-bda6-30943d1aa714 tempest-VolumesSnapshotListTestJSON-1722936526 None] Create snapshot completed successfully
Sep 29 16:46:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-4ead0ef8-14d5-4d0d-a243-1babdd0007ba req-3883ce9e-e257-4383-b8f5-7bab214bfb5d tempest-TestInstancesWithCinderVolumes-1526419312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-d3980dca-033e-4f63-9a23-08c61d34d7b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1a61b32-6ab3-41d5-913c-a667cfe32c23', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:46:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-4ead0ef8-14d5-4d0d-a243-1babdd0007ba req-3883ce9e-e257-4383-b8f5-7bab214bfb5d tempest-TestInstancesWithCinderVolumes-1526419312 None] attachment_update completed successfully.
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-0455fa13-20c8-49f8-8e45-6fab44f66451-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-0455fa13-20c8-49f8-8e45-6fab44f66451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-0455fa13-20c8-49f8-8e45-6fab44f66451" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-0455fa13-20c8-49f8-8e45-6fab44f66451" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Deleting offline snapshot 0455fa13-20c8-49f8-8e45-6fab44f66451 of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] snapshot_file for this snap is: volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf7990-d721-47ed-a854-efbde672749a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:45 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451
Sep 29 16:46:45 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:46 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451" returned: 0 in 0.406s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cdb1b9-26d4-4c6f-ab7d-22d1cfb83fa9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:46 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:46 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:46 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.424s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:46 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451
Sep 29 16:46:46 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:47 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451" returned: 0 in 0.569s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:47 devstack sudo[104447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451
Sep 29 16:46:47 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:47 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.0455fa13-20c8-49f8-8e45-6fab44f66451" returned: 0 in 0.300s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-0455fa13-20c8-49f8-8e45-6fab44f66451" released by "_delete_snapshot" :: held 1.839s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" released by "delete_snapshot" :: held 1.870s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Created reservations ['75d98d95-b262-4f56-b8fc-dfcb10ce497d', 'b6b3fe74-c827-464e-b171-7ea27a095810', 'a75fa7d1-0c86-454a-be64-346efdac5a42', '51594c1e-948a-4c17-af0c-ca1a57ad3011'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Delete snapshot completed successfully.
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ad83b42e-3513-4d68-97b1-e731a707502d tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-0455fa13-20c8-49f8-8e45-6fab44f66451-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-e02313ed-48d4-42c1-9c8c-69db66176037-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-e02313ed-48d4-42c1-9c8c-69db66176037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-e02313ed-48d4-42c1-9c8c-69db66176037" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-e02313ed-48d4-42c1-9c8c-69db66176037" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Deleting offline snapshot e02313ed-48d4-42c1-9c8c-69db66176037 of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] snapshot_file for this snap is: volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb8a562-5e83-4916-a819-fc19c0fe9274]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:48 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:48 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:48 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.449s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a07488-c261-49ff-a977-cc2647ad6d02]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:48 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:48 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:48 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.439s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:48 devstack sudo[104475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:48 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:49 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.430s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:49 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037
Sep 29 16:46:49 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:49 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.e02313ed-48d4-42c1-9c8c-69db66176037" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-e02313ed-48d4-42c1-9c8c-69db66176037" released by "_delete_snapshot" :: held 1.691s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" released by "delete_snapshot" :: held 1.712s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Created reservations ['ff0f71d5-419a-4df7-86ab-558dd328e6bf', 'ebf25050-d45f-4800-8798-98008fd413e4', 'c05daa3a-b2af-4437-992e-d1ee304a17d3', '511b238f-e57a-439f-8548-0012c27d8861'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Delete snapshot completed successfully.
Sep 29 16:46:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c8dc40f5-4ecd-44c0-83ef-ea95be6485df tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-e02313ed-48d4-42c1-9c8c-69db66176037-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-77c2e72f-d765-4401-80cd-39d2c903163b-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-77c2e72f-d765-4401-80cd-39d2c903163b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-77c2e72f-d765-4401-80cd-39d2c903163b" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-77c2e72f-d765-4401-80cd-39d2c903163b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Deleting offline snapshot 77c2e72f-d765-4401-80cd-39d2c903163b of volume 5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] snapshot_file for this snap is: volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb913e3-5184-4b22-a654-a6e13b55f83d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:50 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:50 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-7252c46c-b737-4aa8-b347-f6eb94f70699 req-db2cc032-ec4e-4aa5-8ac2-cad2fee4a5ee tempest-TestInstancesWithCinderVolumes-1526419312 None] Terminate volume connection completed successfully.
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-7252c46c-b737-4aa8-b347-f6eb94f70699 req-db2cc032-ec4e-4aa5-8ac2-cad2fee4a5ee tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleting attachment 8ea6fea0-ea23-47a0-8e26-bc6761300a0c. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:46:50 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.431s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c617534-8d8c-4624-a6d9-a20eca71580e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252141c-c1c5-47ff-8706-8a4df055700e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:50 devstack sudo[104512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e
Sep 29 16:46:50 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:51 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:51 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:51 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-quobyte-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cb4fff-1216-4440-a537-7c5a5b6b2ded]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:51 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2
Sep 29 16:46:51 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:51 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.479s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:51 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b
Sep 29 16:46:51 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:51 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" returned: 0 in 0.499s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:51 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2
Sep 29 16:46:51 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Flow 'volume_create_manager' (2bedeeca-318b-47ac-ab72-cac781932659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:51 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ebd2a9-3bf6-4ea2-a091-80d677361c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e.77c2e72f-d765-4401-80cd-39d2c903163b" returned: 0 in 0.367s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ebd2a9-3bf6-4ea2-a091-80d677361c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e259c378-68dc-4e54-8093-3fa191afb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef130cf852be44e0b6da2a265b262c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:52Z,use_quota=True,user_id='fd467725af7944028c4277b3b6c31b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eeec7d16-1541-43f0-9a50-b755483e76e5),volume_type_id=eeec7d16-1541-43f0-9a50-b755483e76e5)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f482315b-d691-483c-ae5a-3f71826c3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f482315b-d691-483c-ae5a-3f71826c3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c065c93-f80f-4e71-a73a-9278b7492265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:51 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-77c2e72f-d765-4401-80cd-39d2c903163b" released by "_delete_snapshot" :: held 1.900s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" released by "delete_snapshot" :: held 1.932s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:52 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" returned: 0 in 0.342s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2" released by "delete_volume" :: held 0.899s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Created reservations ['14f2a345-6cf7-4f4f-8a57-ad93f7cce999', 'f5278014-5a78-4511-b333-9bcd157937cc', 'b903ccda-c304-455b-a252-dc752cedd460', '145a4413-2979-47e0-a054-c3fbf0b0b33c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:52 devstack cinder-volume[86843]: WARNING cinder.quota [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063650136-2060536750 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063650136-2060536750, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:52 devstack cinder-volume[86843]: WARNING cinder.quota [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063650136-2060536750 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063650136-2060536750, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Created reservations ['051ed11e-1f10-4ab7-9d9c-358463d060e5', '44d053e6-dfe1-494c-afdc-88db3a6f4c83', '2e0931b3-b797-4545-b7d9-f868027fd531', 'd2c1db69-56dd-4241-a4bb-5a192110f187'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Delete snapshot completed successfully.
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0af5c728-3988-4a6e-ae4e-fb600ba5bb62 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-77c2e72f-d765-4401-80cd-39d2c903163b-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:52 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:52 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c065c93-f80f-4e71-a73a-9278b7492265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e259c378-68dc-4e54-8093-3fa191afb55f', 'volume_name': 'volume-e259c378-68dc-4e54-8093-3fa191afb55f', 'volume_size': 1, 'image_id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ac62a6c7378403224a4b46ea9ab2d05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef130cf852be44e0b6da2a265b262c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b6c25fbf00cb0dfb76da7a3bca3e400655017b0e833064ef37bf64420c3e7c798bf088edf92cb4bf1cdfc91536ca1e659f21e44b6bc3daa9c9d24179f393560', 'id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'created_at': datetime.datetime(2026, 9, 29, 14, 46, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a86a7a91-7485-48f8-9a81-129c4b914b17/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560edc3daf0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd31fb30-0582-42b9-9346-54e54bd8d1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd31fb30-0582-42b9-9346-54e54bd8d1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a179d83e-c0d0-4ee1-a434-122c9381e6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Volume e259c378-68dc-4e54-8093-3fa191afb55f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e259c378-68dc-4e54-8093-3fa191afb55f', 'volume_size': 1, 'image_id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ac62a6c7378403224a4b46ea9ab2d05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef130cf852be44e0b6da2a265b262c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b6c25fbf00cb0dfb76da7a3bca3e400655017b0e833064ef37bf64420c3e7c798bf088edf92cb4bf1cdfc91536ca1e659f21e44b6bc3daa9c9d24179f393560', 'id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'created_at': datetime.datetime(2026, 9, 29, 14, 46, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a86a7a91-7485-48f8-9a81-129c4b914b17/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560edc3daf0>}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Trying to clone e259c378-68dc-4e54-8093-3fa191afb55f from image a86a7a91-7485-48f8-9a81-129c4b914b17 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:46:52 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d8aa3e-78d7-4caa-87df-69ac63b01233]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:52 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleted volume successfully.
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9587c2f-7e1c-42d6-af94-bdc88162906a tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-b1b6dfc5-0619-41a0-9052-9c5f3d1fa7a2-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:52 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:52 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:52 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:53 devstack sudo[104545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:53 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:53 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Temporary image a86a7a91-7485-48f8-9a81-129c4b914b17 is fetched for user fd467725af7944028c4277b3b6c31b28. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[74409fd4-4f2f-4384-9503-5ef9557da579]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-5c617534-8d8c-4624-a6d9-a20eca71580e-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-5c617534-8d8c-4624-a6d9-a20eca71580e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:53 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:53 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be93047-f654-4862-8da2-2ffaa08eed77]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:53 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:53 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:53 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e
Sep 29 16:46:53 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:53 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:53 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:46:53 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:53 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:53 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e" returned: 0 in 0.431s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:54 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e
Sep 29 16:46:54 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:54 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e259c378-68dc-4e54-8093-3fa191afb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef130cf852be44e0b6da2a265b262c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:52Z,use_quota=True,user_id='fd467725af7944028c4277b3b6c31b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eeec7d16-1541-43f0-9a50-b755483e76e5),volume_type_id=eeec7d16-1541-43f0-9a50-b755483e76e5)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Creating volume e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:46:54 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:54 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1073741824
Sep 29 16:46:54 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:54 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5c617534-8d8c-4624-a6d9-a20eca71580e" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-quobyte-5c617534-8d8c-4624-a6d9-a20eca71580e" released by "delete_volume" :: held 0.803s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Created reservations ['dedd0574-39c2-4e0a-842e-2d3a10188cd0', '0b6af895-9238-4ce2-82c8-1a875fc98f80', '6743f324-4d21-41a9-ac70-cb167566c47c', 'a9ad2952-82a9-47b2-a0ea-6d5ea25f26d6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:54 devstack sudo[104595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:54 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:54 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:54 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Deleted volume successfully.
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1073741824" returned: 0 in 0.573s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-083d852a-f0fa-46b5-a6a4-014589938488 tempest-VolumesSnapshotListTestJSON-1722936526 None] Lock "cinder-5c617534-8d8c-4624-a6d9-a20eca71580e-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:54 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f
Sep 29 16:46:54 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:55 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Attempting download of a86a7a91-7485-48f8-9a81-129c4b914b17 ((None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}])) to volume e259c378-68dc-4e54-8093-3fa191afb55f. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341477b-f5e4-403c-a662-83fac1fe595f]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:55 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue
Sep 29 16:46:55 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-5c1b2e4a-19b3-4650-9b82-39f0e83df52e req-f9806b8b-86cd-4baa-b481-4f217f45ffd7 tempest-TestInstancesWithCinderVolumes-1526419312 None] Terminate volume connection completed successfully.
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-5c1b2e4a-19b3-4650-9b82-39f0e83df52e req-f9806b8b-86cd-4baa-b481-4f217f45ffd7 tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleting attachment d1a61b32-6ab3-41d5-913c-a667cfe32c23. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:46:55 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue" returned: 0 in 0.356s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:55 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue
Sep 29 16:46:55 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:55 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue" returned: 1 in 0.354s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a86a7a91-7485-48f8-9a81-129c4b914b17_xn1axlue' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a7af7-1f85-4e1d-acff-f1934d0562ec]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-d3980dca-033e-4f63-9a23-08c61d34d7b3-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-d3980dca-033e-4f63-9a23-08c61d34d7b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:56 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:56 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-quobyte-d3980dca-033e-4f63-9a23-08c61d34d7b3" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-d3980dca-033e-4f63-9a23-08c61d34d7b3" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c1fdc-33db-4be6-8e20-6e6dcbff4c1f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:56 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3
Sep 29 16:46:56 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:56 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:56 devstack sudo[104623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD
Sep 29 16:46:56 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:56 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3" returned: 0 in 0.514s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:56 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3
Sep 29 16:46:56 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:56 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] a86a7a91-7485-48f8-9a81-129c4b914b17 was raw, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:46:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:56 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f
Sep 29 16:46:56 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:56 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d3980dca-033e-4f63-9a23-08c61d34d7b3" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-d3980dca-033e-4f63-9a23-08c61d34d7b3" released by "delete_volume" :: held 0.909s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:57 devstack cinder-volume[86843]: WARNING cinder.quota [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-418260717-435247641 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-418260717-435247641, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:57 devstack cinder-volume[86843]: WARNING cinder.quota [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-418260717-435247641 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-418260717-435247641, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Created reservations ['53a1588d-fd61-48f8-bfb0-7dd78efb67f3', '0588b3df-6c1b-49cb-bb3b-d569f0d2f1a7', '321699f0-9a1f-422a-8771-478100804cd0', '008dc6f5-265b-49c9-8a33-dc0943153327'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:57 devstack sudo[104639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:57 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:57 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f" returned: 0 in 0.625s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a86a7a91-7485-48f8-9a81-129c4b914b17_r6kba6yudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:46:57 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:57 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1G
Sep 29 16:46:57 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:57 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.358s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleted volume successfully.
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-bbd8cc1e-7ade-4571-b1bb-1e191dc4e61b tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-d3980dca-033e-4f63-9a23-08c61d34d7b3-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:57 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f 1G" returned: 0 in 0.429s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Downloaded image a86a7a91-7485-48f8-9a81-129c4b914b17 ((None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}])) to volume e259c378-68dc-4e54-8093-3fa191afb55f successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Temporary image a86a7a91-7485-48f8-9a81-129c4b914b17 for user fd467725af7944028c4277b3b6c31b28 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Marking volume e259c378-68dc-4e54-8093-3fa191afb55f as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Copying metadata from image a86a7a91-7485-48f8-9a81-129c4b914b17 to e259c378-68dc-4e54-8093-3fa191afb55f. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:46:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Creating volume glance metadata for volume e259c378-68dc-4e54-8093-3fa191afb55f backed by image a86a7a91-7485-48f8-9a81-129c4b914b17 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5ac62a6c7378403224a4b46ea9ab2d05', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a179d83e-c0d0-4ee1-a434-122c9381e6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e259c378-68dc-4e54-8093-3fa191afb55f', 'volume_size': 1, 'image_id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a86a7a91-7485-48f8-9a81-129c4b914b17', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ac62a6c7378403224a4b46ea9ab2d05', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef130cf852be44e0b6da2a265b262c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b6c25fbf00cb0dfb76da7a3bca3e400655017b0e833064ef37bf64420c3e7c798bf088edf92cb4bf1cdfc91536ca1e659f21e44b6bc3daa9c9d24179f393560', 'id': 'a86a7a91-7485-48f8-9a81-129c4b914b17', 'created_at': datetime.datetime(2026, 9, 29, 14, 46, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a86a7a91-7485-48f8-9a81-129c4b914b17/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560edc3daf0>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37898a8-79d7-44ff-aa40-513acdb2f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:46:58 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Volume volume-e259c378-68dc-4e54-8093-3fa191afb55f (e259c378-68dc-4e54-8093-3fa191afb55f): created successfully
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37898a8-79d7-44ff-aa40-513acdb2f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Flow 'volume_create_manager' (2bedeeca-318b-47ac-ab72-cac781932659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:46:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b6fafdc5-3363-4b89-9610-42bd872973a5 tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Created volume successfully.
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Acquiring lock "cinder-e259c378-68dc-4e54-8093-3fa191afb55f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "cinder-e259c378-68dc-4e54-8093-3fa191afb55f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Acquiring lock "cinder-quobyte-e259c378-68dc-4e54-8093-3fa191afb55f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "cinder-quobyte-e259c378-68dc-4e54-8093-3fa191afb55f" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb71e5-b3da-4d3b-b268-1267345a00d5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:58 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f
Sep 29 16:46:58 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:58 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:58 devstack sudo[104654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f
Sep 29 16:46:58 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:59 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e259c378-68dc-4e54-8093-3fa191afb55f" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "cinder-quobyte-e259c378-68dc-4e54-8093-3fa191afb55f" released by "delete_volume" :: held 0.778s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:46:59 devstack cinder-volume[86843]: WARNING cinder.quota [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:59 devstack cinder-volume[86843]: WARNING cinder.quota [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Created reservations ['a0f7ca16-efe4-427e-adff-73409dbc9377', '68e945f6-149a-45b6-b108-d98247560111', '15205291-4db2-4a4e-9e85-4c28f579f884', 'e0dac0b9-988b-40de-8cfc-f19db3e9f5ec'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:46:59 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:46:59 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:46:59 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.493s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:46:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Deleted volume successfully.
Sep 29 16:46:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c4790588-1f3e-4144-b141-ed67032ff03f tempest-VolumeAndVolumeTypeFromImageTest-1161413097 None] Lock "cinder-e259c378-68dc-4e54-8093-3fa191afb55f-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-1e72d627-aa5a-4ca5-8cc2-b9887617bc3d req-57e148a4-39b9-4eaf-a0e2-f75fab63deb2 tempest-TestInstancesWithCinderVolumes-1526419312 None] Terminate volume connection completed successfully.
Sep 29 16:47:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-1e72d627-aa5a-4ca5-8cc2-b9887617bc3d req-57e148a4-39b9-4eaf-a0e2-f75fab63deb2 tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleting attachment 46896443-b5b5-4fd6-b9c4-6fc060510aa2. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-9675700a-c84f-468a-8a6f-50823d02b641-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-9675700a-c84f-468a-8a6f-50823d02b641-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "cinder-quobyte-9675700a-c84f-468a-8a6f-50823d02b641" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-9675700a-c84f-468a-8a6f-50823d02b641" acquired by "delete_volume" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6bd565-64a1-4ded-86c7-e0b92c91ea67]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:03 devstack sudo[104688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641
Sep 29 16:47:03 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:03 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:03 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641
Sep 29 16:47:03 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:03 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9675700a-c84f-468a-8a6f-50823d02b641" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-quobyte-9675700a-c84f-468a-8a6f-50823d02b641" released by "delete_volume" :: held 0.801s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:03 devstack cinder-volume[86843]: WARNING cinder.quota [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652754646-2031718748 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652754646-2031718748, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:47:03 devstack cinder-volume[86843]: WARNING cinder.quota [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652754646-2031718748 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652754646-2031718748, it is now deprecated. Please use the default quota class for default quota.
Sep 29 16:47:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Created reservations ['5f519b08-4b08-42f8-b0a8-b566e39d60df', 'eb0c28ed-cf14-4df4-8794-f4c8cc4a30ce', '3d84f860-d126-458c-8116-7161305d2552', '7dc61974-6f1b-42f5-a3f2-1e8cd94745ca'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:04 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:04 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:04 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Deleted volume successfully.
Sep 29 16:47:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23f7104c-1e01-4a6a-89e2-9248d316ad6d tempest-TestInstancesWithCinderVolumes-1526419312 None] Lock "cinder-9675700a-c84f-468a-8a6f-50823d02b641-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (1e1cb88c-b5fd-462d-b6b9-732a3a3e3c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c7d6d-cbc2-40d6-a273-8c0879931302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c7d6d-cbc2-40d6-a273-8c0879931302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742775647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd52654-d6b8-4f56-a0f0-3075506aab7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:06Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3020c-523b-4741-accf-78e2ddbb14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3020c-523b-4741-accf-78e2ddbb14bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabcf91d-f107-422e-9603-632f5dcc9bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabcf91d-f107-422e-9603-632f5dcc9bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd52654-d6b8-4f56-a0f0-3075506aab7c', 'volume_name': 'volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce822037-c514-443a-adce-2f9ed35c8f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce822037-c514-443a-adce-2f9ed35c8f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b9237b-464f-4e2b-b398-ca0a5e2243b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Volume 5dd52654-d6b8-4f56-a0f0-3075506aab7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c', 'volume_size': 1}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742775647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd52654-d6b8-4f56-a0f0-3075506aab7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:06Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Creating volume 5dd52654-d6b8-4f56-a0f0-3075506aab7c {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:06 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:06 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c 1073741824
Sep 29 16:47:06 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (35ee64d3-abab-4d06-a4b1-1fa518422cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bda49e-a0b0-40ea-837f-5ce4b0a291ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bda49e-a0b0-40ea-837f-5ce4b0a291ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013446254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852df71-a1ab-4f48-b8cf-aa32e8cfe590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:07Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa779517-578c-472c-a4b4-5038a368b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa779517-578c-472c-a4b4-5038a368b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc43c788-6e0e-47e6-bfab-98a4733db2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc43c788-6e0e-47e6-bfab-98a4733db2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1852df71-a1ab-4f48-b8cf-aa32e8cfe590', 'volume_name': 'volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8315e-ad8f-4261-8774-968da55f5124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8315e-ad8f-4261-8774-968da55f5124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd9eeb-4da6-4513-89da-975c0066f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Volume 1852df71-a1ab-4f48-b8cf-aa32e8cfe590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590', 'volume_size': 1}
Sep 29 16:47:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:07 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c 1073741824" returned: 0 in 0.708s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:07 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c
Sep 29 16:47:07 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (be7f831a-a63a-4b47-b205-7af8e1880df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06473565-5161-4055-a2a3-091e02a7bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06473565-5161-4055-a2a3-091e02a7bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346222305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3686667d-34f1-4387-a184-24580e3b0845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:07Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9209dfa-0dd0-4801-a9de-e230d11b67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9209dfa-0dd0-4801-a9de-e230d11b67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6148ba6-dcf7-41aa-8395-7778f5b6c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6148ba6-dcf7-41aa-8395-7778f5b6c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3686667d-34f1-4387-a184-24580e3b0845', 'volume_name': 'volume-3686667d-34f1-4387-a184-24580e3b0845', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7bedfa-c13d-4bae-944f-bb5fd6baa052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7bedfa-c13d-4bae-944f-bb5fd6baa052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165109c3-214f-4e61-b467-b0c2dc3960b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Volume 3686667d-34f1-4387-a184-24580e3b0845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3686667d-34f1-4387-a184-24580e3b0845', 'volume_size': 1}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c" returned: 0 in 0.415s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013446254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852df71-a1ab-4f48-b8cf-aa32e8cfe590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:07Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Creating volume 1852df71-a1ab-4f48-b8cf-aa32e8cfe590 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:07 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b9237b-464f-4e2b-b398-ca0a5e2243b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 1073741824
Sep 29 16:47:07 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a552e8ea-b533-4e8a-885d-190a7e19873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:07 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Volume volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c (5dd52654-d6b8-4f56-a0f0-3075506aab7c): created successfully
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a552e8ea-b533-4e8a-885d-190a7e19873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (1e1cb88c-b5fd-462d-b6b9-732a3a3e3c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-339889f0-cfe8-49b8-9c30-d2ed7c02e71c tempest-CreateVolumesFromImageTest-732564877 None] Created volume successfully.
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (f4fbd8f2-9f67-49a9-be7f-87d94aa1af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa62b0d-da74-479a-8e2f-f3bf5afb5fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa62b0d-da74-479a-8e2f-f3bf5afb5fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-465494872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85b36ea-b4a8-4dbc-9287-9fba581184ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:08Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec1dccb-8c7c-4b5c-9a93-41d5a1ae79d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec1dccb-8c7c-4b5c-9a93-41d5a1ae79d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692c82cc-d5ef-4e21-9ab4-aae29d90ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692c82cc-d5ef-4e21-9ab4-aae29d90ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85b36ea-b4a8-4dbc-9287-9fba581184ef', 'volume_name': 'volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f5c670-434c-43a4-894b-217160864fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f5c670-434c-43a4-894b-217160864fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8a01da-37b0-4dcb-a66e-1bb9c5db80eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Volume a85b36ea-b4a8-4dbc-9287-9fba581184ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef', 'volume_size': 1}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:08 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 1073741824" returned: 0 in 0.681s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:08 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590
Sep 29 16:47:08 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (264ad654-ae3e-4bc0-95d8-e57c86782164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4301865-fb75-46d9-bd00-ee629a96fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4301865-fb75-46d9-bd00-ee629a96fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600831837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c49a66f-e835-4de9-9a63-53ca05e8f879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:09Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab5ce12-64ef-432c-b3ee-bc0156af5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab5ce12-64ef-432c-b3ee-bc0156af5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9316af7b-6896-4d7e-ad09-539b1bcd9432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9316af7b-6896-4d7e-ad09-539b1bcd9432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c49a66f-e835-4de9-9a63-53ca05e8f879', 'volume_name': 'volume-6c49a66f-e835-4de9-9a63-53ca05e8f879', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4491685-d46e-4a01-905c-f8668fe924fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4491685-d46e-4a01-905c-f8668fe924fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04da32c2-48ba-4512-b450-f2c6f28ef792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Volume 6c49a66f-e835-4de9-9a63-53ca05e8f879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c49a66f-e835-4de9-9a63-53ca05e8f879', 'volume_size': 1}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:08 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" returned: 0 in 0.463s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346222305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3686667d-34f1-4387-a184-24580e3b0845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:07Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Creating volume 3686667d-34f1-4387-a184-24580e3b0845 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:08 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd9eeb-4da6-4513-89da-975c0066f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack sudo[104722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 1073741824
Sep 29 16:47:08 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4610edd6-8e2a-4c32-a7f6-4fadf2856f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Volume volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 (1852df71-a1ab-4f48-b8cf-aa32e8cfe590): created successfully
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4610edd6-8e2a-4c32-a7f6-4fadf2856f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (35ee64d3-abab-4d06-a4b1-1fa518422cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c932216b-37be-436c-82d2-7eb300179144 tempest-CreateVolumesFromImageTest-732564877 None] Created volume successfully.
Sep 29 16:47:09 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 1073741824" returned: 0 in 0.526s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:09 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845
Sep 29 16:47:09 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:09 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-465494872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85b36ea-b4a8-4dbc-9287-9fba581184ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:08Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Creating volume a85b36ea-b4a8-4dbc-9287-9fba581184ef {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:09 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165109c3-214f-4e61-b467-b0c2dc3960b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3686667d-34f1-4387-a184-24580e3b0845', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad7cc53-227c-4570-9548-a333561dd1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:09 devstack sudo[104731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef 1073741824
Sep 29 16:47:09 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Volume volume-3686667d-34f1-4387-a184-24580e3b0845 (3686667d-34f1-4387-a184-24580e3b0845): created successfully
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad7cc53-227c-4570-9548-a333561dd1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (be7f831a-a63a-4b47-b205-7af8e1880df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f3c965da-4bc3-4690-afbe-b65cdc690c1a tempest-CreateVolumesFromImageTest-732564877 None] Created volume successfully.
Sep 29 16:47:10 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef 1073741824" returned: 0 in 0.642s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:10 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef
Sep 29 16:47:10 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:10 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1600831837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c49a66f-e835-4de9-9a63-53ca05e8f879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab027f300b694c6788130a2bad31a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:09Z,use_quota=True,user_id='2906f732519449d8957b54df815b641c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Creating volume 6c49a66f-e835-4de9-9a63-53ca05e8f879 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:10 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8a01da-37b0-4dcb-a66e-1bb9c5db80eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f52ff49-0091-47c6-8a5f-eaaa8ab61a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:10 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 1073741824
Sep 29 16:47:10 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:10 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Volume volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef (a85b36ea-b4a8-4dbc-9287-9fba581184ef): created successfully
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f52ff49-0091-47c6-8a5f-eaaa8ab61a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (f4fbd8f2-9f67-49a9-be7f-87d94aa1af4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3df2b32c-c3f2-4b3a-a8ae-2b65f460e1ca tempest-CreateVolumesFromImageTest-732564877 None] Created volume successfully.
Sep 29 16:47:11 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 1073741824" returned: 0 in 0.642s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:11 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879
Sep 29 16:47:11 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:11 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879" returned: 0 in 0.266s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04da32c2-48ba-4512-b450-f2c6f28ef792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c49a66f-e835-4de9-9a63-53ca05e8f879', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2841bb9-aeed-4263-87dd-c7631f24f0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Volume volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 (6c49a66f-e835-4de9-9a63-53ca05e8f879): created successfully
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2841bb9-aeed-4263-87dd-c7631f24f0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Flow 'volume_create_manager' (264ad654-ae3e-4bc0-95d8-e57c86782164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-01c81933-f894-4818-b982-9ca6fbf9ff2d tempest-CreateVolumesFromImageTest-732564877 None] Created volume successfully.
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-6c49a66f-e835-4de9-9a63-53ca05e8f879-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-6c49a66f-e835-4de9-9a63-53ca05e8f879-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-quobyte-6c49a66f-e835-4de9-9a63-53ca05e8f879" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-6c49a66f-e835-4de9-9a63-53ca05e8f879" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b33d63-2b83-4e9e-917b-0253a5774dd5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:12 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879
Sep 29 16:47:12 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:12 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879" returned: 0 in 0.421s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:12 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879
Sep 29 16:47:12 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:12 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6c49a66f-e835-4de9-9a63-53ca05e8f879" returned: 0 in 0.301s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-6c49a66f-e835-4de9-9a63-53ca05e8f879" released by "delete_volume" :: held 0.777s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Created reservations ['a5f886c3-e8c4-4231-83a3-372f5a0d1fa8', '26910f18-9e2d-4a93-b203-a66166e71ba6', '9142710e-d31d-4d87-9c9f-a2f9979cef39', 'd3b1010d-3b93-4f2f-910f-3394f58aa7c8'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:13 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:13 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-a85b36ea-b4a8-4dbc-9287-9fba581184ef-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-a85b36ea-b4a8-4dbc-9287-9fba581184ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=156,cinder:SELECT=133,cinder:INSERT=47,cinder:DELETE=10 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=136,cinder:INSERT=36,cinder:UPDATE=142,cinder:DELETE=11 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-quobyte-a85b36ea-b4a8-4dbc-9287-9fba581184ef" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-a85b36ea-b4a8-4dbc-9287-9fba581184ef" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:13 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:13 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Deleted volume successfully.
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b6564-affc-4c49-89ed-8066346680a5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7f2356d6-37e9-4a19-9eef-a66362519d43 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-6c49a66f-e835-4de9-9a63-53ca05e8f879-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:13 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef
Sep 29 16:47:13 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:14 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef" returned: 0 in 0.496s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:14 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef
Sep 29 16:47:14 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:14 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a85b36ea-b4a8-4dbc-9287-9fba581184ef" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-a85b36ea-b4a8-4dbc-9287-9fba581184ef" released by "delete_volume" :: held 0.864s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Created reservations ['73589c6f-76a9-4b43-bef0-af0eab1167ca', '8a1e3190-f69a-4642-b7dd-9b6195a224ab', 'b4d5e2b9-b9f2-4cb7-9dda-027c2879af16', 'cd5233c7-8e78-4049-a876-6bad4dbf4677'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-3686667d-34f1-4387-a184-24580e3b0845-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:14 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:14 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-3686667d-34f1-4387-a184-24580e3b0845-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-quobyte-3686667d-34f1-4387-a184-24580e3b0845" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-3686667d-34f1-4387-a184-24580e3b0845" acquired by "delete_volume" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[736629ce-4170-479b-89f1-8646303b4825]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:14 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845
Sep 29 16:47:14 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:14 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.403s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Deleted volume successfully.
Sep 29 16:47:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-64a84f07-128f-47fa-a348-24d05b6668af tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-a85b36ea-b4a8-4dbc-9287-9fba581184ef-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:15 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845" returned: 0 in 0.471s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:15 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845
Sep 29 16:47:15 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:15 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3686667d-34f1-4387-a184-24580e3b0845" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-3686667d-34f1-4387-a184-24580e3b0845" released by "delete_volume" :: held 0.804s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Created reservations ['770a598e-d0c1-440c-bbb3-363fce8c0d17', 'bb225f8d-555e-4fac-ab95-5acfe0527adc', '6d3c3765-2ae7-44cc-ba8d-9354be421a7d', '692f24f5-65b1-4dce-98dd-c6334d5f2014'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:15 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:15 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-1852df71-a1ab-4f48-b8cf-aa32e8cfe590-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-1852df71-a1ab-4f48-b8cf-aa32e8cfe590-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-quobyte-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:15 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.295s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Deleted volume successfully.
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1455d4dd-fb87-4ccf-87aa-8e58579af6b6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0518e2bf-f084-4edc-9da2-5a1110b33e02 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-3686667d-34f1-4387-a184-24580e3b0845-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:16 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590
Sep 29 16:47:16 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:16 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" returned: 0 in 0.459s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:16 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590
Sep 29 16:47:16 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:16 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" returned: 0 in 0.295s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-1852df71-a1ab-4f48-b8cf-aa32e8cfe590" released by "delete_volume" :: held 0.827s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Created reservations ['e9158e7b-25af-4806-9e2a-9e20fd954583', 'e48092df-bd56-4413-9fd5-4e5d4ee847fb', 'e50444e4-88a2-477c-ac77-8676baa14719', 'f0338a49-b4c8-4f7a-8da9-96cd127d625a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:16 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:16 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-5dd52654-d6b8-4f56-a0f0-3075506aab7c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-5dd52654-d6b8-4f56-a0f0-3075506aab7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "cinder-quobyte-5dd52654-d6b8-4f56-a0f0-3075506aab7c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:17 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Deleted volume successfully.
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-5dd52654-d6b8-4f56-a0f0-3075506aab7c" acquired by "delete_volume" :: waited 0.042s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b341803-2d73-4872-a8cb-1e6bd6427903 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-1852df71-a1ab-4f48-b8cf-aa32e8cfe590-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94e11f8-b642-41b6-9ad8-e5fee054167e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:17 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c
Sep 29 16:47:17 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:17 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:17 devstack sudo[104807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c
Sep 29 16:47:17 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:18 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5dd52654-d6b8-4f56-a0f0-3075506aab7c" returned: 0 in 0.300s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-quobyte-5dd52654-d6b8-4f56-a0f0-3075506aab7c" released by "delete_volume" :: held 0.917s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Created reservations ['4942c067-fc33-4c17-b7d8-e9125124551b', 'd26a4679-b777-494a-b544-12d49966055d', 'f6e5ca7f-50d4-4f0b-883d-15dfc8cacf67', 'a417993c-12f6-4167-971c-d990003a545a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:18 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:18 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:18 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Deleted volume successfully.
Sep 29 16:47:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-aa283e7a-d949-459e-823b-65dbe742d688 tempest-CreateVolumesFromImageTest-732564877 None] Lock "cinder-5dd52654-d6b8-4f56-a0f0-3075506aab7c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Flow 'volume_create_manager' (54a61c8d-01d9-413b-9881-0489ff2bd13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63716348-3717-45cc-b849-7b1b351b1cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63716348-3717-45cc-b849-7b1b351b1cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506147039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b18ed-c56d-4d5e-a135-6cb706aeb62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5e9721df344f65ab128bc420ab1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:22Z,use_quota=True,user_id='cc07a405451a4f32b2b95194073ca449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed95395-7f4c-4b66-91e9-cc58f68b8049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed95395-7f4c-4b66-91e9-cc58f68b8049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e54b9b2-7cdd-4af3-b722-c158d3ca7603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e54b9b2-7cdd-4af3-b722-c158d3ca7603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5b18ed-c56d-4d5e-a135-6cb706aeb62a', 'volume_name': 'volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9001f68-51b5-4808-aebf-de9807c3e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9001f68-51b5-4808-aebf-de9807c3e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70da747a-95a2-420f-9b86-bcdcd4f43abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:22 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Volume ef5b18ed-c56d-4d5e-a135-6cb706aeb62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a', 'volume_size': 1}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506147039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b18ed-c56d-4d5e-a135-6cb706aeb62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5e9721df344f65ab128bc420ab1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:22Z,use_quota=True,user_id='cc07a405451a4f32b2b95194073ca449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Creating volume ef5b18ed-c56d-4d5e-a135-6cb706aeb62a {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:22 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:22 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a 1073741824
Sep 29 16:47:22 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (6efddc28-f0c7-44dd-9129-c795c27b6577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a55da8-a4a5-4079-882c-ea836672c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a 1073741824" returned: 0 in 0.611s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a55da8-a4a5-4079-882c-ea836672c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102110759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429e1e45-39ea-4315-a587-8de06916a25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:23Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd8d4f-bd02-49ca-bc7b-7c86790dabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd8d4f-bd02-49ca-bc7b-7c86790dabe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc07bf-cf36-46d5-bed9-8ff5cb722176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc07bf-cf36-46d5-bed9-8ff5cb722176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429e1e45-39ea-4315-a587-8de06916a25b', 'volume_name': 'volume-429e1e45-39ea-4315-a587-8de06916a25b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7fd8e5-ad7a-436d-9707-8ea25fb26141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7fd8e5-ad7a-436d-9707-8ea25fb26141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcecf71-d67c-4ce7-bd77-262ab765ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume 429e1e45-39ea-4315-a587-8de06916a25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429e1e45-39ea-4315-a587-8de06916a25b', 'volume_size': 1}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:23 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a
Sep 29 16:47:23 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:23 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" returned: 0 in 0.310s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102110759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429e1e45-39ea-4315-a587-8de06916a25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:23Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume 429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:23 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:23 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b 1073741824
Sep 29 16:47:23 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70da747a-95a2-420f-9b86-bcdcd4f43abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ae327-5884-4385-82d5-f8f97139640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Volume volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a (ef5b18ed-c56d-4d5e-a135-6cb706aeb62a): created successfully
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ae327-5884-4385-82d5-f8f97139640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Flow 'volume_create_manager' (54a61c8d-01d9-413b-9881-0489ff2bd13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4ed47b87-ac29-4ecd-b329-43936287602e tempest-ProjectReaderTests-809676943 None] Created volume successfully.
Sep 29 16:47:24 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b 1073741824" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:24 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b
Sep 29 16:47:24 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:24 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcecf71-d67c-4ce7-bd77-262ab765ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429e1e45-39ea-4315-a587-8de06916a25b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3599e50c-0ddb-4ff3-b04e-1c9d7b06f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:24 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-429e1e45-39ea-4315-a587-8de06916a25b (429e1e45-39ea-4315-a587-8de06916a25b): created successfully
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3599e50c-0ddb-4ff3-b04e-1c9d7b06f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (6efddc28-f0c7-44dd-9129-c795c27b6577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-717a3fac-448c-4b13-ba27-fdb5bcf1de59 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Acquiring lock "cinder-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "cinder-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Acquiring lock "cinder-quobyte-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "cinder-quobyte-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6903933c-cc63-4956-be03-b54af63575a6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:25 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a
Sep 29 16:47:25 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:25 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" returned: 0 in 0.406s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:25 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a
Sep 29 16:47:25 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating offline snapshot 7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 of volume 429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:47:25 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" returned: 0 in 0.305s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c83341-34e9-4230-82cb-893ad8d29dff]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "cinder-quobyte-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a" released by "delete_volume" :: held 0.782s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Created reservations ['bd607f7c-121b-4eca-81ba-f679983d5647', '42cc34ca-b9e3-4cf2-8258-4127bac2e64b', '7eb7bb1d-c82e-4964-b66f-df09bf262181', '442d21ca-4e9a-46e8-ba68-ddceda6febd7'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:25 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b
Sep 29 16:47:25 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:25 devstack sudo[104843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:25 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:26 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:26 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:26 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 1G
Sep 29 16:47:26 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Deleted volume successfully.
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6cb2a2b4-b520-497a-bdd2-d4a1afcd50fe tempest-ProjectReaderTests-809676943 None] Lock "cinder-ef5b18ed-c56d-4d5e-a135-6cb706aeb62a-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Flow 'volume_create_manager' (6cf60fba-b42d-45aa-a442-16eb42c21b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93359483-5b84-4b30-bdcc-e9f4fdd7315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93359483-5b84-4b30-bdcc-e9f4fdd7315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769073961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bbee3e-876c-4eab-8974-6be06b732139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5e9721df344f65ab128bc420ab1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:26Z,use_quota=True,user_id='cc07a405451a4f32b2b95194073ca449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0244598-a9a1-4d70-a0ea-7172b426dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0244598-a9a1-4d70-a0ea-7172b426dadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f39d8c-8e6f-4397-9947-272d76128087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f39d8c-8e6f-4397-9947-272d76128087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7bbee3e-876c-4eab-8974-6be06b732139', 'volume_name': 'volume-f7bbee3e-876c-4eab-8974-6be06b732139', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cb8dc7-c34d-49a5-9715-de5e9426c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cb8dc7-c34d-49a5-9715-de5e9426c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea5c5c5-68b0-4306-8691-cac41d03f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:26 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Volume f7bbee3e-876c-4eab-8974-6be06b732139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7bbee3e-876c-4eab-8974-6be06b732139', 'volume_size': 1}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 1G" returned: 0 in 0.550s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429e1e45-39ea-4315-a587-8de06916a25b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:26 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429e1e45-39ea-4315-a587-8de06916a25b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0
Sep 29 16:47:26 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:26 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429e1e45-39ea-4315-a587-8de06916a25b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:26 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 is being set with open permissions: ugo+rw
Sep 29 16:47:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:26 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0
Sep 29 16:47:26 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:27 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:27 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info
Sep 29 16:47:27 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:27 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:27 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info is being set with open permissions: ugo+rw
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:27 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info
Sep 29 16:47:27 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:27 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.info" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769073961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bbee3e-876c-4eab-8974-6be06b732139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5e9721df344f65ab128bc420ab1c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:26Z,use_quota=True,user_id='cc07a405451a4f32b2b95194073ca449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Creating volume f7bbee3e-876c-4eab-8974-6be06b732139 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:27 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:27 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 1073741824
Sep 29 16:47:27 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:27 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2fff823c-2871-4129-81d4-acff6026ea75 tempest-CreateVolumesFromSnapshotTest-641490578 None] Create snapshot completed successfully
Sep 29 16:47:28 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 1073741824" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:28 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139
Sep 29 16:47:28 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:28 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea5c5c5-68b0-4306-8691-cac41d03f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bbee3e-876c-4eab-8974-6be06b732139', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425f78a-cdff-4af8-9855-4aa193f6c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:28 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Volume volume-f7bbee3e-876c-4eab-8974-6be06b732139 (f7bbee3e-876c-4eab-8974-6be06b732139): created successfully
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425f78a-cdff-4af8-9855-4aa193f6c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Flow 'volume_create_manager' (6cf60fba-b42d-45aa-a442-16eb42c21b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-143e4ac2-1666-488a-aa36-08ebcc9236b5 tempest-ProjectReaderTests-809676943 None] Created volume successfully.
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (b4764548-0e8b-4daf-ab30-abeb97bdc325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce1f45f-a6b0-46ff-a272-6cae4dc4bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce1f45f-a6b0-46ff-a272-6cae4dc4bc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561273122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c80faa-9be2-4c02-9196-4ee212df316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:29Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddefbe0-dad6-48a6-b8ee-6467879e6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddefbe0-dad6-48a6-b8ee-6467879e6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7e331b-eae1-49b2-ae1d-2940efbfc1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7e331b-eae1-49b2-ae1d-2940efbfc1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c80faa-9be2-4c02-9196-4ee212df316b', 'volume_name': 'volume-f3c80faa-9be2-4c02-9196-4ee212df316b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008f0840-2b19-4560-82b1-cb22fa8c141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008f0840-2b19-4560-82b1-cb22fa8c141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2990d74-c7d5-4384-94a9-d0ca25d882e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:29 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume f3c80faa-9be2-4c02-9196-4ee212df316b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c80faa-9be2-4c02-9196-4ee212df316b', 'volume_size': 1}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561273122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c80faa-9be2-4c02-9196-4ee212df316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:29Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume f3c80faa-9be2-4c02-9196-4ee212df316b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:29 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:29 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b 1073741824
Sep 29 16:47:29 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:29 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (2d9fc9ea-b5d7-4636-ba35-5e6eeffab210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff184cd-2dad-4294-868c-7e3131e48524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Acquiring lock "cinder-f7bbee3e-876c-4eab-8974-6be06b732139-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff184cd-2dad-4294-868c-7e3131e48524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097374055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f223535e-c555-42f8-9ec4-fe22629fd9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:30Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fa16f7-01b0-4ebb-9ae2-0abbd6b3d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fa16f7-01b0-4ebb-9ae2-0abbd6b3d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad7692e-d93c-49e0-92e6-f469aa8efcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad7692e-d93c-49e0-92e6-f469aa8efcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f223535e-c555-42f8-9ec4-fe22629fd9f4', 'volume_name': 'volume-f223535e-c555-42f8-9ec4-fe22629fd9f4', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2554cff-d9dc-4aa4-84b4-08fc97de933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2554cff-d9dc-4aa4-84b4-08fc97de933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b18f5d-1950-48f8-b397-5b6e4dad4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume f223535e-c555-42f8-9ec4-fe22629fd9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f223535e-c555-42f8-9ec4-fe22629fd9f4', 'volume_size': 1}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "cinder-f7bbee3e-876c-4eab-8974-6be06b732139-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Acquiring lock "cinder-quobyte-f7bbee3e-876c-4eab-8974-6be06b732139" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "cinder-quobyte-f7bbee3e-876c-4eab-8974-6be06b732139" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef10392-7ace-412c-bfcd-6fda6ec34048]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:30 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b 1073741824" returned: 0 in 1.039s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:30 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139
Sep 29 16:47:30 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (91a649ff-e188-4a81-8473-9989ab8a0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7808a06e-c72a-4e70-a1ff-58ccbbd80cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7808a06e-c72a-4e70-a1ff-58ccbbd80cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453097691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59183d9a-c7c0-4e57-ae8d-22fee1cbf981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:31Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525c2c87-4957-432d-9a83-a24cb503ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525c2c87-4957-432d-9a83-a24cb503ea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b
Sep 29 16:47:30 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35609114-2a5b-4027-8b57-a987922f2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35609114-2a5b-4027-8b57-a987922f2f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59183d9a-c7c0-4e57-ae8d-22fee1cbf981', 'volume_name': 'volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907d054f-d85e-48d7-9ce4-4bc98e2513fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907d054f-d85e-48d7-9ce4-4bc98e2513fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff97435-0583-490c-aa29-e0abf6c8ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:30 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume 59183d9a-c7c0-4e57-ae8d-22fee1cbf981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981', 'volume_size': 1}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:30 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139" returned: 0 in 0.560s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:31 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139
Sep 29 16:47:31 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:31 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b" returned: 0 in 0.376s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097374055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f223535e-c555-42f8-9ec4-fe22629fd9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:30Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume f223535e-c555-42f8-9ec4-fe22629fd9f4 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:31 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2990d74-c7d5-4384-94a9-d0ca25d882e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c80faa-9be2-4c02-9196-4ee212df316b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376dba0a-269c-4185-b41e-f95705f328e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 1073741824
Sep 29 16:47:31 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-f3c80faa-9be2-4c02-9196-4ee212df316b (f3c80faa-9be2-4c02-9196-4ee212df316b): created successfully
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376dba0a-269c-4185-b41e-f95705f328e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (b4764548-0e8b-4daf-ab30-abeb97bdc325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1eabc371-a04d-49b1-b79e-ec49fa171ebb tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (85b705eb-c7e6-4631-9937-82f7a35886a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b409367-467b-484b-a554-96e2b2adb2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b409367-467b-484b-a554-96e2b2adb2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-194164339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caee7853-1c03-44bb-80a9-cb474f225326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:31Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07f9f67-b902-4e9e-9ae3-550ca67de07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07f9f67-b902-4e9e-9ae3-550ca67de07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4679557-cbec-4b2e-b54c-9820fe193dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4679557-cbec-4b2e-b54c-9820fe193dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caee7853-1c03-44bb-80a9-cb474f225326', 'volume_name': 'volume-caee7853-1c03-44bb-80a9-cb474f225326', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db19bf7-d393-4af9-9a80-38fad7ff5342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db19bf7-d393-4af9-9a80-38fad7ff5342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d84f461-e689-46dc-8278-8915602831f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume caee7853-1c03-44bb-80a9-cb474f225326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caee7853-1c03-44bb-80a9-cb474f225326', 'volume_size': 1}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:31 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f7bbee3e-876c-4eab-8974-6be06b732139" returned: 0 in 0.428s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "cinder-quobyte-f7bbee3e-876c-4eab-8974-6be06b732139" released by "delete_volume" :: held 1.087s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Created reservations ['41ac27fa-9655-4202-b319-1d393fedd9b4', '2f475670-bbfb-4e30-acb5-d9300476d4d6', '920c20ba-467a-43a9-ade0-644cf93393cc', '98c29c86-da05-42f6-b419-619a69c37318'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:31 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (d9c73115-ba8b-40fa-ab20-68552d01deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5de137-3f23-485d-b364-571728ef5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 1073741824" returned: 0 in 0.741s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5de137-3f23-485d-b364-571728ef5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395184947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1c1c8f-4247-4c8b-a386-efd3aa4924bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:32Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aba7e93-8a86-4c1f-aec9-34ac7bbfa6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aba7e93-8a86-4c1f-aec9-34ac7bbfa6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950cfac-ddf3-4256-94a8-657cd3f84135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950cfac-ddf3-4256-94a8-657cd3f84135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b1c1c8f-4247-4c8b-a386-efd3aa4924bc', 'volume_name': 'volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d451cdf-c0e4-45bf-a6ca-0436ba292416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d451cdf-c0e4-45bf-a6ca-0436ba292416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3b5f72-b245-4105-8294-e1aeafad726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume 8b1c1c8f-4247-4c8b-a386-efd3aa4924bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc', 'volume_size': 1}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:31 devstack sudo[104924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:31 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:31 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4
Sep 29 16:47:31 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:32 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Deleted volume successfully.
Sep 29 16:47:32 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453097691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59183d9a-c7c0-4e57-ae8d-22fee1cbf981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:31Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume 59183d9a-c7c0-4e57-ae8d-22fee1cbf981 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:32 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b18f5d-1950-48f8-b397-5b6e4dad4180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f223535e-c555-42f8-9ec4-fe22629fd9f4', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:32 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 1073741824
Sep 29 16:47:32 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7add923-0296-46de-b2e4-43b8fc75754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f9ec94fb-dad6-4ae0-bae8-b853f6e84d03 tempest-ProjectReaderTests-809676943 None] Lock "cinder-f7bbee3e-876c-4eab-8974-6be06b732139-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 (f223535e-c555-42f8-9ec4-fe22629fd9f4): created successfully
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7add923-0296-46de-b2e4-43b8fc75754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (2d9fc9ea-b5d7-4636-ba35-5e6eeffab210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7e7cdba5-a2e8-4345-a455-444b43c0062f tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:32 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 1073741824" returned: 0 in 0.770s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:33 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981
Sep 29 16:47:33 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:33 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-194164339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caee7853-1c03-44bb-80a9-cb474f225326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:31Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume caee7853-1c03-44bb-80a9-cb474f225326 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:33 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:33 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 1073741824
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff97435-0583-490c-aa29-e0abf6c8ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:33 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74038865-fd50-4562-9bcf-e7ecb54a06fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 (59183d9a-c7c0-4e57-ae8d-22fee1cbf981): created successfully
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74038865-fd50-4562-9bcf-e7ecb54a06fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (91a649ff-e188-4a81-8473-9989ab8a0d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3bafe5a4-3208-4c0c-818a-e08f9fb8c371 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:34 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 1073741824" returned: 0 in 0.795s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:34 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326
Sep 29 16:47:34 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:34 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395184947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1c1c8f-4247-4c8b-a386-efd3aa4924bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2de4ee953ea4db38d69ce231c94709e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:32Z,use_quota=True,user_id='8107651b10c744e88d5bfb855eb9f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Creating volume 8b1c1c8f-4247-4c8b-a386-efd3aa4924bc {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:34 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:34 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc 1073741824
Sep 29 16:47:34 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d84f461-e689-46dc-8278-8915602831f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caee7853-1c03-44bb-80a9-cb474f225326', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733afbd9-53e0-4eb5-af8d-abab9d85bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-caee7853-1c03-44bb-80a9-cb474f225326 (caee7853-1c03-44bb-80a9-cb474f225326): created successfully
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733afbd9-53e0-4eb5-af8d-abab9d85bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (85b705eb-c7e6-4631-9937-82f7a35886a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-fc78825a-a2f3-4184-a428-a9daa4343501 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:35 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc 1073741824" returned: 0 in 0.557s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:35 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc
Sep 29 16:47:35 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:35 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3b5f72-b245-4105-8294-e1aeafad726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f7e7ed-0c91-40d7-ae53-45a5401c4661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Volume volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc (8b1c1c8f-4247-4c8b-a386-efd3aa4924bc): created successfully
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f7e7ed-0c91-40d7-ae53-45a5401c4661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Flow 'volume_create_manager' (d9c73115-ba8b-40fa-ab20-68552d01deb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d36dd0eb-c71d-4db2-920b-572c1a804dde tempest-CreateVolumesFromSnapshotTest-641490578 None] Created volume successfully.
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e5ff65-ca4d-4df1-ab8b-db86b1f66848]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:36 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc
Sep 29 16:47:36 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:37 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" returned: 0 in 0.467s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:37 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc
Sep 29 16:47:37 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:37 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" returned: 0 in 0.288s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc" released by "delete_volume" :: held 0.826s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['a8f17dde-b064-4741-b24c-50ab1b32606a', 'b16ccbe2-d838-41c1-b679-579aa7a38231', '219cefcc-108d-4087-8a84-a4ba174ae18b', '6b72324b-f89d-4e9d-9a3b-37e8f1874fc0'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:37 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:37 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-caee7853-1c03-44bb-80a9-cb474f225326-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-caee7853-1c03-44bb-80a9-cb474f225326-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-caee7853-1c03-44bb-80a9-cb474f225326" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-caee7853-1c03-44bb-80a9-cb474f225326" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e5207-2665-41a7-be4b-023322b9e289]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:37 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.366s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-26b86559-f38f-4b62-b3b4-7168f0246b49 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-8b1c1c8f-4247-4c8b-a386-efd3aa4924bc-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:37 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326
Sep 29 16:47:37 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:38 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:38 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326
Sep 29 16:47:38 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:38 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-caee7853-1c03-44bb-80a9-cb474f225326" returned: 0 in 0.266s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-caee7853-1c03-44bb-80a9-cb474f225326" released by "delete_volume" :: held 0.769s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['b2efa022-df8d-46f2-aabd-1d2ffc30ce17', 'a466ca7d-8367-4960-8d48-678db8b52116', '79e426df-47cb-4cc6-b91f-5c8ca4c51998', '1cfe8236-6555-4312-b193-b98fd4889137'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:38 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:38 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-59183d9a-c7c0-4e57-ae8d-22fee1cbf981-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-59183d9a-c7c0-4e57-ae8d-22fee1cbf981-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:38 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:38 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[86285fd3-46b1-4acc-b766-3b24e7ed5054]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ef869110-52ad-4864-bac2-023e70522bc1 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-caee7853-1c03-44bb-80a9-cb474f225326-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:39 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981
Sep 29 16:47:39 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:39 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" returned: 0 in 0.386s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:39 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981
Sep 29 16:47:39 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:39 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-59183d9a-c7c0-4e57-ae8d-22fee1cbf981" released by "delete_volume" :: held 0.702s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['de7ae83b-d2fe-408a-a062-7cd4ce7b9565', '5e28415e-c58d-4db4-83d4-661aec650e18', 'c01387af-0ef2-40e7-ad06-be4d5b22866d', '2ee1a825-9fcf-44d4-8f19-9e5e56682fa7'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:39 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:39 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:40 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.268s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-36fa4b0f-704f-4f64-9ebb-05eb39180494 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-59183d9a-c7c0-4e57-ae8d-22fee1cbf981-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-f223535e-c555-42f8-9ec4-fe22629fd9f4-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-f223535e-c555-42f8-9ec4-fe22629fd9f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-f223535e-c555-42f8-9ec4-fe22629fd9f4" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-f223535e-c555-42f8-9ec4-fe22629fd9f4" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcf9e6-4713-4131-abd9-9f463fd99970]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:40 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4
Sep 29 16:47:40 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:40 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4" returned: 0 in 0.358s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:40 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4
Sep 29 16:47:40 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:40 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f223535e-c555-42f8-9ec4-fe22629fd9f4" returned: 0 in 0.239s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-f223535e-c555-42f8-9ec4-fe22629fd9f4" released by "delete_volume" :: held 0.644s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['f91d4701-bd8e-4dce-a459-5ca5544848bc', '833c6d93-9a1f-4401-8022-7771dd073a01', '259d54be-7efc-48aa-92fe-00144c3d367c', 'fcdde797-d14c-422e-be55-145cb5581f09'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:41 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:41 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:41 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c1d2b2d5-f58e-4e36-92a7-e86b31743ea3 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-f223535e-c555-42f8-9ec4-fe22629fd9f4-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-f3c80faa-9be2-4c02-9196-4ee212df316b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-f3c80faa-9be2-4c02-9196-4ee212df316b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-f3c80faa-9be2-4c02-9196-4ee212df316b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-f3c80faa-9be2-4c02-9196-4ee212df316b" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ebbd5-6cb0-4d1c-8b14-370239708f71]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:41 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b
Sep 29 16:47:41 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:41 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:41 devstack sudo[105092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b
Sep 29 16:47:41 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:42 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3c80faa-9be2-4c02-9196-4ee212df316b" returned: 0 in 0.243s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-f3c80faa-9be2-4c02-9196-4ee212df316b" released by "delete_volume" :: held 0.666s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['954277fa-fa67-43b0-921b-8dfda2c7bdff', '9cb3bcde-f06f-45d7-ad45-2ecc70e4c571', 'cebf2a8c-3a1c-4396-b365-81db2ab57e60', '2544a42f-0da5-42d9-a1b0-2b49a8bfcac5'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:42 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:42 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:42 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-782132dd-ce9b-4d50-ac42-b74f7793db12 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-f3c80faa-9be2-4c02-9196-4ee212df316b-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleting offline snapshot 7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 of volume 429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] snapshot_file for this snap is: volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d739156-a038-4b90-aa69-91d00d318be5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:42 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0
Sep 29 16:47:42 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:42 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429e1e45-39ea-4315-a587-8de06916a25b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f90cfe-4c52-458f-8c6b-31a1f7e98f45]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:43 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b
Sep 29 16:47:43 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:43 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b" returned: 0 in 0.362s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:43 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0
Sep 29 16:47:43 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:43 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" returned: 0 in 0.320s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:43 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0
Sep 29 16:47:43 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:43 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b.7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0" released by "_delete_snapshot" :: held 1.404s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" released by "delete_snapshot" :: held 1.428s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['6820a0aa-8194-459a-bce7-b4d4f139cb6f', 'defe992b-939a-44eb-a87c-5cb0f2ecfe19', '80b60a1c-c812-422c-87b7-70cbefd4de0b', 'f7790e76-3c6f-4411-938f-c0df4024f81b'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Delete snapshot completed successfully.
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cadb6791-ce04-4485-9c61-dae14b80d1e0 tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-7e9ed0ea-ce17-435d-bef0-a5bf5baa71a0-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-429e1e45-39ea-4315-a587-8de06916a25b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-429e1e45-39ea-4315-a587-8de06916a25b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a49d3-d937-4eaf-a837-0e884a6a25ef]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:44 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b
Sep 29 16:47:44 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:45 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b" returned: 0 in 0.371s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:45 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b
Sep 29 16:47:45 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:45 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-429e1e45-39ea-4315-a587-8de06916a25b" returned: 0 in 0.245s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-quobyte-429e1e45-39ea-4315-a587-8de06916a25b" released by "delete_volume" :: held 0.676s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Created reservations ['26d2c378-4c41-425d-b836-5ac0b7ce4907', '08031643-fab0-49b8-b739-59c55489d985', '8b3bad58-8b3a-4d9d-855e-6d68eab89131', '2653a396-5c30-454e-8b3a-12a09d1a06a4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:45 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:45 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:45 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Deleted volume successfully.
Sep 29 16:47:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1a7a7a76-b043-4af2-be30-d6d5db1b313c tempest-CreateVolumesFromSnapshotTest-641490578 None] Lock "cinder-429e1e45-39ea-4315-a587-8de06916a25b-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Flow 'volume_create_manager' (9989fcbc-ee14-4e18-a8f1-e099d46a3c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b85f90d-3aa6-4671-b798-bee8cfb4a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b85f90d-3aa6-4671-b798-bee8cfb4a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1442454778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a050b15-5103-43f9-91bd-2f812365552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6091483e8f314b84aa1b217a34b264b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:49Z,use_quota=True,user_id='86cada63458045e2a0072c3c946c3db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124a722b-6a33-4748-8ca9-0731fe57051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124a722b-6a33-4748-8ca9-0731fe57051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f686e91-1a0e-4924-89f5-6300efcf0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f686e91-1a0e-4924-89f5-6300efcf0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a050b15-5103-43f9-91bd-2f812365552b', 'volume_name': 'volume-4a050b15-5103-43f9-91bd-2f812365552b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ebf310-2b98-4a52-a28e-d5f01954a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ebf310-2b98-4a52-a28e-d5f01954a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5e0fc8-ee6c-4813-adcd-e665ffa99520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:48 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Volume 4a050b15-5103-43f9-91bd-2f812365552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a050b15-5103-43f9-91bd-2f812365552b', 'volume_size': 1}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1442454778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a050b15-5103-43f9-91bd-2f812365552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6091483e8f314b84aa1b217a34b264b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:49Z,use_quota=True,user_id='86cada63458045e2a0072c3c946c3db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Creating volume 4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:48 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:47:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:48 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b 1073741824
Sep 29 16:47:48 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:49 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b 1073741824" returned: 0 in 0.411s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:49 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:47:49 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:49 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5e0fc8-ee6c-4813-adcd-e665ffa99520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a050b15-5103-43f9-91bd-2f812365552b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c5ef0-b6b7-4e8f-9ce5-a73d54a3ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Volume volume-4a050b15-5103-43f9-91bd-2f812365552b (4a050b15-5103-43f9-91bd-2f812365552b): created successfully
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c5ef0-b6b7-4e8f-9ce5-a73d54a3ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Flow 'volume_create_manager' (9989fcbc-ee14-4e18-a8f1-e099d46a3c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6911447d-5caa-4a0b-8cf7-e465d466b9d9 tempest-VolumeDependencyTests-1229653222 None] Created volume successfully.
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Creating offline snapshot c29d714f-f127-42d8-bf31-47ebe4b0ecb6 of volume 4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999407d-f5eb-4da5-929f-49d8f5e96c70]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:50 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:47:50 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:50 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.350s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:50 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 1G
Sep 29 16:47:50 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:50 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 1G" returned: 0 in 0.387s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a050b15-5103-43f9-91bd-2f812365552b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:50 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a050b15-5103-43f9-91bd-2f812365552b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:47:50 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:51 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a050b15-5103-43f9-91bd-2f812365552b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 is being set with open permissions: ugo+rw
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:51 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:47:51 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:51 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:51 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info
Sep 29 16:47:51 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:51 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info is being set with open permissions: ugo+rw
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:51 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info
Sep 29 16:47:51 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:51 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.info" returned: 0 in 0.238s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1d821efb-9214-43b9-931b-bb8ae8b9dfa3 tempest-VolumeDependencyTests-1229653222 None] Create snapshot completed successfully
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Flow 'volume_create_manager' (f537dd1b-2229-4b50-b5ff-da4b669c0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf2a9c1-2b85-4c29-929d-ce927f277c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf2a9c1-2b85-4c29-929d-ce927f277c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1333895752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1f996-549a-4262-ba1b-70914ea77585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6091483e8f314b84aa1b217a34b264b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c29d714f-f127-42d8-bf31-47ebe4b0ecb6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:53Z,use_quota=True,user_id='86cada63458045e2a0072c3c946c3db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc2f3a-1676-4bc2-b184-7640e14f7451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc2f3a-1676-4bc2-b184-7640e14f7451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa2168-46bc-4e6e-8676-30444e84a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa2168-46bc-4e6e-8676-30444e84a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9cc1f996-549a-4262-ba1b-70914ea77585', 'volume_name': 'volume-9cc1f996-549a-4262-ba1b-70914ea77585', 'volume_size': 1, 'snapshot_id': 'c29d714f-f127-42d8-bf31-47ebe4b0ecb6'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd73fa12-b458-4a8d-8052-2cfb0ef224a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd73fa12-b458-4a8d-8052-2cfb0ef224a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0019b0-14d4-43ac-afc2-b87ae1eb0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Volume 9cc1f996-549a-4262-ba1b-70914ea77585: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9cc1f996-549a-4262-ba1b-70914ea77585', 'volume_size': 1, 'snapshot_id': 'c29d714f-f127-42d8-bf31-47ebe4b0ecb6'}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-9cc1f996-549a-4262-ba1b-70914ea77585" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-9cc1f996-549a-4262-ba1b-70914ea77585" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Creating volume 9cc1f996-549a-4262-ba1b-70914ea77585 from snapshot c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] snapshot: c29d714f-f127-42d8-bf31-47ebe4b0ecb6, volume: 9cc1f996-549a-4262-ba1b-70914ea77585,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16afae-7c29-47e6-9b12-bdd13b4352c0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:52 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:47:52 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:53 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a050b15-5103-43f9-91bd-2f812365552b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f869751e-6eb2-4e92-aec8-27bbe3c2e149]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:53 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:47:53 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:53 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:47:53 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:47:53 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:53 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:47:53 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:47:53 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.246s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:47:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Flow 'volume_create_manager' (323fe00c-9abb-4b47-bed1-37258254b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992f3fd2-4746-45d4-9786-5c50ce9c33a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992f3fd2-4746-45d4-9786-5c50ce9c33a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1156781279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6286ea-839d-42c6-811a-167d7ee5b1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66506094c5f4949a6200ec08e936d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:59Z,use_quota=True,user_id='441cbe9f93c5490aba86f1e6a63c3073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36bc086-a566-44a5-a699-5a06dbd4dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36bc086-a566-44a5-a699-5a06dbd4dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75616ac1-908e-4afe-957b-0d10858410b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75616ac1-908e-4afe-957b-0d10858410b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6286ea-839d-42c6-811a-167d7ee5b1e7', 'volume_name': 'volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc6c2ee-c0c6-469e-af36-c9ce81a557f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc6c2ee-c0c6-469e-af36-c9ce81a557f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e770ac87-6753-4ab0-bdef-e939d2ba5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:47:58 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Volume 6f6286ea-839d-42c6-811a-167d7ee5b1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7', 'volume_size': 1}
Sep 29 16:47:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:00 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585" returned: 0 in 6.759s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:48:00 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Converted 1024.00 MB image at 151.49 MB/s
Sep 29 16:48:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 is being set with open permissions: ugo+rw
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:00 devstack sudo[105249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585
Sep 29 16:48:00 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:00 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585" returned: 0 in 0.241s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" released by "_copy_volume_from_snapshot" :: held 7.799s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-9cc1f996-549a-4262-ba1b-70914ea77585" released by "_create_volume_from_snapshot" :: held 7.860s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.874s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1156781279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6286ea-839d-42c6-811a-167d7ee5b1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66506094c5f4949a6200ec08e936d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:59Z,use_quota=True,user_id='441cbe9f93c5490aba86f1e6a63c3073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Creating volume 6f6286ea-839d-42c6-811a-167d7ee5b1e7 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:00 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:00 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 1073741824
Sep 29 16:48:00 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0019b0-14d4-43ac-afc2-b87ae1eb0327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc1f996-549a-4262-ba1b-70914ea77585', 'volume_size': 1, 'snapshot_id': 'c29d714f-f127-42d8-bf31-47ebe4b0ecb6'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ce29a-51fb-4bd3-9515-a2e283897d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:00 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Volume volume-9cc1f996-549a-4262-ba1b-70914ea77585 (9cc1f996-549a-4262-ba1b-70914ea77585): created successfully
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ce29a-51fb-4bd3-9515-a2e283897d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Flow 'volume_create_manager' (f537dd1b-2229-4b50-b5ff-da4b669c0b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:00 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cc8289d5-5a43-43be-845f-9ef3f0f6bc2f tempest-VolumeDependencyTests-1229653222 None] Created volume successfully.
Sep 29 16:48:00 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 1073741824" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:01 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7
Sep 29 16:48:01 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:01 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7" returned: 0 in 0.240s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e770ac87-6753-4ab0-bdef-e939d2ba5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00b0c3e-658e-4d02-84de-6e93729ce1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Volume volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 (6f6286ea-839d-42c6-811a-167d7ee5b1e7): created successfully
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00b0c3e-658e-4d02-84de-6e93729ce1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Flow 'volume_create_manager' (323fe00c-9abb-4b47-bed1-37258254b887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1d3c5637-a0f8-4288-9a03-1a05a474e74d tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Created volume successfully.
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Deleting offline snapshot c29d714f-f127-42d8-bf31-47ebe4b0ecb6 of volume 4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] snapshot_file for this snap is: volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5aef8e-1474-496a-8831-28b36608188a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:01 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:48:01 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:01 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a050b15-5103-43f9-91bd-2f812365552b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cfe5de-6337-4e17-9634-685e8e1b2bd3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:01 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:48:01 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-70b2d0b7-a785-42c9-a16f-2b09e96c84c6 req-8ebe116b-ce3b-4397-b6c6-c1517ed10926 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-70b2d0b7-a785-42c9-a16f-2b09e96c84c6 req-8ebe116b-ce3b-4397-b6c6-c1517ed10926 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [req-70b2d0b7-a785-42c9-a16f-2b09e96c84c6 req-8ebe116b-ce3b-4397-b6c6-c1517ed10926 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:02 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.589s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-70b2d0b7-a785-42c9-a16f-2b09e96c84c6 req-8ebe116b-ce3b-4397-b6c6-c1517ed10926 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17', 'name': 'volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '998327b1-1024-47d0-8842-c76f1878282d', 'enforce_multipath': True} {{(pid=86843) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 16:48:02 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:48:02 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-70b2d0b7-a785-42c9-a16f-2b09e96c84c6 req-8ebe116b-ce3b-4397-b6c6-c1517ed10926 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] attachment_update completed successfully.
Sep 29 16:48:02 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.361s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:02 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6
Sep 29 16:48:02 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:03 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b.c29d714f-f127-42d8-bf31-47ebe4b0ecb6" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-c29d714f-f127-42d8-bf31-47ebe4b0ecb6" released by "_delete_snapshot" :: held 1.699s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" released by "delete_snapshot" :: held 1.723s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Created reservations ['07dad1db-465e-406c-b7a6-e2c67b5ca6c9', 'afdb33e3-a6e5-4ab8-afa2-53a1fd29e610', 'ba72499b-1d22-485f-b31d-ad89ccb5c81d', '9563a5b4-6d5a-4676-b54f-5e6d28318da4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Delete snapshot completed successfully.
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-af78695e-fecd-4762-951c-3aa24e28536c tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-c29d714f-f127-42d8-bf31-47ebe4b0ecb6-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-4a050b15-5103-43f9-91bd-2f812365552b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-4a050b15-5103-43f9-91bd-2f812365552b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[50931455-18a1-44e7-85f0-2bbc27dc9aad]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:03 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:48:03 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:03 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:04 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b
Sep 29 16:48:04 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:04 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-4a050b15-5103-43f9-91bd-2f812365552b" returned: 0 in 0.250s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-4a050b15-5103-43f9-91bd-2f812365552b" released by "delete_volume" :: held 0.682s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Created reservations ['3b13ce98-2a12-4b7a-b9be-82020c074f1a', '61c4b09a-f3be-4377-868f-0a2efd354b3e', '4558da7c-1203-4a47-8800-29c0ab8bd2ba', 'f2871faf-2c9d-48c6-9863-ed4e4d64d69e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:04 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:04 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:04 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.261s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Deleted volume successfully.
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-9cc1f996-549a-4262-ba1b-70914ea77585-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-5da67299-a20a-4e9e-9d6b-1b387c442697 tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-4a050b15-5103-43f9-91bd-2f812365552b-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-9cc1f996-549a-4262-ba1b-70914ea77585-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfdd464-5526-4099-83c0-5e59d6dffc21]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:04 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585
Sep 29 16:48:04 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:05 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:05 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585
Sep 29 16:48:05 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:05 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cc1f996-549a-4262-ba1b-70914ea77585" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-quobyte-9cc1f996-549a-4262-ba1b-70914ea77585" released by "delete_volume" :: held 0.710s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Created reservations ['2a985ee0-847f-4ac5-af2d-441a962a40b7', 'd6ef16a2-7652-456f-abca-28148e8aad4e', '659c0c57-62c4-4e60-9c8a-51e260617003', '5380cacc-be50-4b07-86b6-c2a4db85b99a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:05 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:05 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [req-047008db-3a70-44ff-b29e-b71f1be28a62 req-98948553-6376-45f2-97f6-7e5f5fa48382 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Terminate volume connection completed successfully.
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [req-047008db-3a70-44ff-b29e-b71f1be28a62 req-98948553-6376-45f2-97f6-7e5f5fa48382 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Deleting attachment 998327b1-1024-47d0-8842-c76f1878282d. {{(pid=86843) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 16:48:05 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.286s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Deleted volume successfully.
Sep 29 16:48:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-675f2686-d529-4d95-bd0e-9510d6e8678b tempest-VolumeDependencyTests-1229653222 None] Lock "cinder-9cc1f996-549a-4262-ba1b-70914ea77585-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "cinder-6f6286ea-839d-42c6-811a-167d7ee5b1e7-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "cinder-6f6286ea-839d-42c6-811a-167d7ee5b1e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "cinder-quobyte-6f6286ea-839d-42c6-811a-167d7ee5b1e7" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "cinder-quobyte-6f6286ea-839d-42c6-811a-167d7ee5b1e7" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e537499-d410-4397-a439-50ef76ba23b8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:06 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7
Sep 29 16:48:06 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:06 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:07 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7
Sep 29 16:48:07 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:07 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6f6286ea-839d-42c6-811a-167d7ee5b1e7" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "cinder-quobyte-6f6286ea-839d-42c6-811a-167d7ee5b1e7" released by "delete_volume" :: held 0.698s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Created reservations ['8abe4f5c-80a6-4dad-8f96-6a42dd31f210', 'ad3480b5-59a1-4a17-9a4c-443057ab34c1', 'c7baa614-52e1-4b69-a728-ecc857cc3236', 'dcad5b17-93e5-4677-a0f8-3a50ef4f21c6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:07 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:07 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:07 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.285s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Deleted volume successfully.
Sep 29 16:48:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-16f579c4-e325-4a87-9aaf-390b8d31bc11 tempest-TestServerVolumeAttachScenarioOldVersion-1582948465 None] Lock "cinder-6f6286ea-839d-42c6-811a-167d7ee5b1e7-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Flow 'volume_create_manager' (b4e62920-b9df-40b2-9c46-267a702f7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b08756-85d7-464f-8592-ba405d4daca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b08756-85d7-464f-8592-ba405d4daca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6631a08-698f-448a-ae67-6140c391202e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0691d97f2594e1a9e58bcf31f020beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:09Z,use_quota=True,user_id='9761a870544c4342bd6bdc251a1bdae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2b0f7c-ad89-4ee1-b9df-63f82ff6a4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2b0f7c-ad89-4ee1-b9df-63f82ff6a4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b73f0f5-19eb-4055-adad-61df1ac955fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b73f0f5-19eb-4055-adad-61df1ac955fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6631a08-698f-448a-ae67-6140c391202e', 'volume_name': 'volume-d6631a08-698f-448a-ae67-6140c391202e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d659ddc4-2d4e-46e4-bba5-e47769c3d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d659ddc4-2d4e-46e4-bba5-e47769c3d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a926d7cf-6446-4b5c-a48f-9f8dd52fc3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Volume d6631a08-698f-448a-ae67-6140c391202e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6631a08-698f-448a-ae67-6140c391202e', 'volume_size': 1}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6631a08-698f-448a-ae67-6140c391202e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0691d97f2594e1a9e58bcf31f020beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:09Z,use_quota=True,user_id='9761a870544c4342bd6bdc251a1bdae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Creating volume d6631a08-698f-448a-ae67-6140c391202e {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:09 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:09 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e 1073741824
Sep 29 16:48:09 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:09 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e 1073741824" returned: 0 in 0.443s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:09 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e
Sep 29 16:48:09 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:09 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a926d7cf-6446-4b5c-a48f-9f8dd52fc3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6631a08-698f-448a-ae67-6140c391202e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767de5e8-268e-4576-9330-fe9a7ec0722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Volume volume-d6631a08-698f-448a-ae67-6140c391202e (d6631a08-698f-448a-ae67-6140c391202e): created successfully
Sep 29 16:48:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767de5e8-268e-4576-9330-fe9a7ec0722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Flow 'volume_create_manager' (b4e62920-b9df-40b2-9c46-267a702f7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a011d1ef-973e-47d2-9eb1-26a03c68d43d tempest-CinderUnicodeTest-2041051679 None] Created volume successfully.
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Flow 'volume_create_manager' (fcb04019-72ea-44d3-8154-9bdedfba75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d57945a-e57b-4a0f-89d9-481960661cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d57945a-e57b-4a0f-89d9-481960661cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-72796778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b728205-23ef-45e6-8632-f2a30aa25c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0691d97f2594e1a9e58bcf31f020beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:11Z,use_quota=True,user_id='9761a870544c4342bd6bdc251a1bdae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bd5fa3-66dc-4a8a-bbf7-abe2b833c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bd5fa3-66dc-4a8a-bbf7-abe2b833c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfd1863-ea48-42f9-9e1a-ed95b3f029a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfd1863-ea48-42f9-9e1a-ed95b3f029a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b728205-23ef-45e6-8632-f2a30aa25c7f', 'volume_name': 'volume-8b728205-23ef-45e6-8632-f2a30aa25c7f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0d8456-910b-4bb1-bd10-bb28f1ac2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0d8456-910b-4bb1-bd10-bb28f1ac2d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f16bf-cf4d-4ad6-9d18-e43ee0494f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:10 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Volume 8b728205-23ef-45e6-8632-f2a30aa25c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b728205-23ef-45e6-8632-f2a30aa25c7f', 'volume_size': 1}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-72796778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b728205-23ef-45e6-8632-f2a30aa25c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0691d97f2594e1a9e58bcf31f020beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:11Z,use_quota=True,user_id='9761a870544c4342bd6bdc251a1bdae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Creating volume 8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:10 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:10 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f 1073741824
Sep 29 16:48:10 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:11 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f 1073741824" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:11 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f
Sep 29 16:48:11 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:11 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f" returned: 0 in 0.244s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f16bf-cf4d-4ad6-9d18-e43ee0494f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b728205-23ef-45e6-8632-f2a30aa25c7f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30fa1b-a30b-4824-8e05-1bcb283a1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Volume volume-8b728205-23ef-45e6-8632-f2a30aa25c7f (8b728205-23ef-45e6-8632-f2a30aa25c7f): created successfully
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30fa1b-a30b-4824-8e05-1bcb283a1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Flow 'volume_create_manager' (fcb04019-72ea-44d3-8154-9bdedfba75ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d0ca34a8-6b4c-4a70-b39a-40f5d4c64979 tempest-CinderUnicodeTest-2041051679 None] Created volume successfully.
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Creating offline snapshot 226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 of volume 8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfc46b5-8b38-4a22-99cd-0159b369944d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:12 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f
Sep 29 16:48:12 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:12 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:12 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 1G
Sep 29 16:48:12 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:12 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 1G" returned: 0 in 0.428s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b728205-23ef-45e6-8632-f2a30aa25c7f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:12 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b728205-23ef-45e6-8632-f2a30aa25c7f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3
Sep 29 16:48:12 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:13 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b728205-23ef-45e6-8632-f2a30aa25c7f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" returned: 0 in 0.327s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:13 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 is being set with open permissions: ugo+rw
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:13 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3
Sep 29 16:48:13 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:13 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:DELETE=12,cinder:SELECT=134,cinder:INSERT=43,cinder:UPDATE=174 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=126,cinder:UPDATE=176,cinder:DELETE=19,cinder:INSERT=40 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:13 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info
Sep 29 16:48:13 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:13 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info" returned: 0 in 0.251s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:13 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info is being set with open permissions: ugo+rw
Sep 29 16:48:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:13 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info
Sep 29 16:48:13 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:14 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.info" returned: 0 in 0.292s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-98b50d8c-9f5c-4775-91b8-1fb79840ee03 tempest-CinderUnicodeTest-2041051679 None] Create snapshot completed successfully
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-quobyte-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Deleting offline snapshot 226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 of volume 8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] snapshot_file for this snap is: volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b94bc98-fc35-4a5b-8b61-8e49b20906e1]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:15 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3
Sep 29 16:48:15 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:15 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b728205-23ef-45e6-8632-f2a30aa25c7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3fc15-c570-436c-964e-5d837c3338d4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:15 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f
Sep 29 16:48:15 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:16 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f" returned: 0 in 0.462s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:16 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3
Sep 29 16:48:16 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:16 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:16 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3
Sep 29 16:48:16 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:16 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f.226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3" released by "_delete_snapshot" :: held 1.623s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" released by "delete_snapshot" :: held 1.650s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Created reservations ['07af7f1f-606a-4962-8dd5-4891f6fe5b85', '50af7ee6-7304-4d95-aa61-85dcf9de6be1', '92a5bdf5-ab19-4a6a-a1a3-44d0cb82e47d', '68f0cad7-59b6-4338-a96b-5a11ab84cc00'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Delete snapshot completed successfully.
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18519593-2397-4791-b3cf-cdc38c1ec6b5 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-226dc0ae-bf01-4f83-b24b-ab3273e7d2a3-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-8b728205-23ef-45e6-8632-f2a30aa25c7f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-8b728205-23ef-45e6-8632-f2a30aa25c7f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac5fb0-21f9-4426-a633-f036dffee7e7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:17 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f
Sep 29 16:48:17 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:17 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:17 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f
Sep 29 16:48:17 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:18 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b728205-23ef-45e6-8632-f2a30aa25c7f" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-8b728205-23ef-45e6-8632-f2a30aa25c7f" released by "delete_volume" :: held 0.735s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Created reservations ['0032ac91-2147-4cb5-87f0-1cca6ec45f91', '877840e8-3ba2-44c7-8c7b-c2824fed97e1', '7a7ac654-df3d-4644-a419-61fc1706afaf', '5191d540-c9ad-4a2b-9368-372cf9a05932'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:18 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:18 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-d6631a08-698f-448a-ae67-6140c391202e-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-d6631a08-698f-448a-ae67-6140c391202e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "cinder-quobyte-d6631a08-698f-448a-ae67-6140c391202e" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:18 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.316s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Deleted volume successfully.
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-d6631a08-698f-448a-ae67-6140c391202e" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c57a417e-08c7-43a9-be5b-28aef4aa87ca tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-8b728205-23ef-45e6-8632-f2a30aa25c7f-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[40090c55-74b9-43f7-b20e-88e8fb5f4663]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:18 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e
Sep 29 16:48:18 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:19 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e" returned: 0 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:19 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e
Sep 29 16:48:19 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:19 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d6631a08-698f-448a-ae67-6140c391202e" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-quobyte-d6631a08-698f-448a-ae67-6140c391202e" released by "delete_volume" :: held 0.698s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Created reservations ['dc567978-909e-4ba4-9e1d-5ed9f7c1e30e', 'd864911d-6e17-43aa-ad7f-71c2674f35dc', 'eda66be8-0c1d-4811-9f0c-7581601fe2a3', 'a3d9398e-64f4-48e8-9c95-91ea05a32148'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:19 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:19 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:19 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.251s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Deleted volume successfully.
Sep 29 16:48:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4f8e6824-4025-4559-b24d-328a69e4cbe9 tempest-CinderUnicodeTest-2041051679 None] Lock "cinder-d6631a08-698f-448a-ae67-6140c391202e-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (110b6a8b-5833-49bd-85fe-5543d62d7dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3917f6a0-b84a-4a76-a4f4-3c8e61a0be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3917f6a0-b84a-4a76-a4f4-3c8e61a0be24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718639561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36014093-db35-4a47-bcdd-f846b31ccf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:29Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6ae667-413b-4ce1-91b3-20bd05df3a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6ae667-413b-4ce1-91b3-20bd05df3a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a465c16c-7ff8-43b4-a5c4-ef074e6ff93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a465c16c-7ff8-43b4-a5c4-ef074e6ff93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36014093-db35-4a47-bcdd-f846b31ccf64', 'volume_name': 'volume-36014093-db35-4a47-bcdd-f846b31ccf64', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315f38a-b360-4c70-96f8-0e6e3ba9cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315f38a-b360-4c70-96f8-0e6e3ba9cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb59e70-6189-4ac0-94cf-de9d307aa8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:28 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Volume 36014093-db35-4a47-bcdd-f846b31ccf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36014093-db35-4a47-bcdd-f846b31ccf64', 'volume_size': 1}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718639561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36014093-db35-4a47-bcdd-f846b31ccf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:29Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Creating volume 36014093-db35-4a47-bcdd-f846b31ccf64 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:28 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:28 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 1073741824
Sep 29 16:48:28 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:29 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 1073741824" returned: 0 in 0.441s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:29 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64
Sep 29 16:48:29 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:29 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64" returned: 0 in 0.252s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb59e70-6189-4ac0-94cf-de9d307aa8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36014093-db35-4a47-bcdd-f846b31ccf64', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2ec18a-12c8-4ad3-9af0-31ecc33f1082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:29 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Volume volume-36014093-db35-4a47-bcdd-f846b31ccf64 (36014093-db35-4a47-bcdd-f846b31ccf64): created successfully
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2ec18a-12c8-4ad3-9af0-31ecc33f1082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (110b6a8b-5833-49bd-85fe-5543d62d7dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-13a43267-263e-4171-9580-8fc34a6096da tempest-ProjectReaderTests-58714135 None] Created volume successfully.
Sep 29 16:48:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-36014093-db35-4a47-bcdd-f846b31ccf64-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "cinder-36014093-db35-4a47-bcdd-f846b31ccf64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-quobyte-36014093-db35-4a47-bcdd-f846b31ccf64" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-36014093-db35-4a47-bcdd-f846b31ccf64" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a56b2a-815f-4d7a-841f-621501e610a7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:31 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64
Sep 29 16:48:31 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:31 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:31 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64
Sep 29 16:48:31 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:31 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-36014093-db35-4a47-bcdd-f846b31ccf64" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-36014093-db35-4a47-bcdd-f846b31ccf64" released by "delete_volume" :: held 0.757s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Created reservations ['3fe71084-e902-4014-a9b6-f68212b75700', '9d84b9c8-919a-4626-877a-9eb085401433', 'b7856b6f-c0c0-4811-978e-f970804fb04d', 'fb66ef2b-7187-46a1-8d4b-4ae20016671c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:31 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:31 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:32 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Deleted volume successfully.
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-290d9c20-a3fc-469a-8a9f-6ad01240ed66 tempest-ProjectReaderTests-58714135 None] Lock "cinder-36014093-db35-4a47-bcdd-f846b31ccf64-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (57c5ff47-d6ed-45a1-98c1-1dfe73a1a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761a112d-6b91-444f-9301-559fa8d418bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761a112d-6b91-444f-9301-559fa8d418bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110190420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7846053d-8f41-4dd1-9fcb-87419ff2699c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:33Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1cfcb-829b-4107-aa5f-39df3711e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1cfcb-829b-4107-aa5f-39df3711e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656ef649-a99e-4903-9811-0efe42cebae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656ef649-a99e-4903-9811-0efe42cebae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7846053d-8f41-4dd1-9fcb-87419ff2699c', 'volume_name': 'volume-7846053d-8f41-4dd1-9fcb-87419ff2699c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06c768-7ab5-4744-b0b2-4168f48d089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06c768-7ab5-4744-b0b2-4168f48d089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd04006-ebd4-4034-9d79-3a420df190b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:32 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Volume 7846053d-8f41-4dd1-9fcb-87419ff2699c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7846053d-8f41-4dd1-9fcb-87419ff2699c', 'volume_size': 1}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110190420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7846053d-8f41-4dd1-9fcb-87419ff2699c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:33Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Creating volume 7846053d-8f41-4dd1-9fcb-87419ff2699c {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:32 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:32 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c 1073741824
Sep 29 16:48:32 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:33 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c 1073741824" returned: 0 in 0.464s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:33 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c
Sep 29 16:48:33 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:33 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd04006-ebd4-4034-9d79-3a420df190b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7846053d-8f41-4dd1-9fcb-87419ff2699c', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ac44f-4abd-47ac-bcb1-da906b1830d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Volume volume-7846053d-8f41-4dd1-9fcb-87419ff2699c (7846053d-8f41-4dd1-9fcb-87419ff2699c): created successfully
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ac44f-4abd-47ac-bcb1-da906b1830d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (57c5ff47-d6ed-45a1-98c1-1dfe73a1a67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-27ef2175-c933-46c8-8f8b-9a131b63cf60 tempest-ProjectReaderTests-58714135 None] Created volume successfully.
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-7846053d-8f41-4dd1-9fcb-87419ff2699c-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "cinder-7846053d-8f41-4dd1-9fcb-87419ff2699c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-quobyte-7846053d-8f41-4dd1-9fcb-87419ff2699c" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-7846053d-8f41-4dd1-9fcb-87419ff2699c" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0b2254-1da5-4a55-a7fc-844fe38e1cf8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:35 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c
Sep 29 16:48:35 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:35 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:35 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c
Sep 29 16:48:35 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:35 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7846053d-8f41-4dd1-9fcb-87419ff2699c" returned: 0 in 0.261s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-7846053d-8f41-4dd1-9fcb-87419ff2699c" released by "delete_volume" :: held 0.697s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Created reservations ['f1f3e37d-94af-4254-9a32-03b888b54702', 'cd84170f-ebcd-454f-991c-86aa8ad38c43', '920a93a4-4a5f-439c-b374-af08bd944ac3', '1f4c3787-17fd-492e-84c0-89a0a40ba3f2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:35 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:35 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:36 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:36 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Deleted volume successfully.
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-08c2a03f-eed5-4242-805a-625335fe30ef tempest-ProjectReaderTests-58714135 None] Lock "cinder-7846053d-8f41-4dd1-9fcb-87419ff2699c-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (63e165d1-1043-4f55-b202-aaa7637a362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d4805e-5657-4074-b65e-9aaf057dea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d4805e-5657-4074-b65e-9aaf057dea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984048526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a2d0c8-368c-48ab-8235-533598af56c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:36Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64f18aa-a1ca-4e2d-b6ae-c2a67aa4c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64f18aa-a1ca-4e2d-b6ae-c2a67aa4c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a866653f-a524-4def-bd0f-c1592475d8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a866653f-a524-4def-bd0f-c1592475d8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a2d0c8-368c-48ab-8235-533598af56c7', 'volume_name': 'volume-a6a2d0c8-368c-48ab-8235-533598af56c7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ada1d2-334f-4460-a857-b40ff54589c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ada1d2-334f-4460-a857-b40ff54589c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e3d395-243b-407c-97d5-1c96fce26b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:36 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Volume a6a2d0c8-368c-48ab-8235-533598af56c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a2d0c8-368c-48ab-8235-533598af56c7', 'volume_size': 1}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984048526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a2d0c8-368c-48ab-8235-533598af56c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:36Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Creating volume a6a2d0c8-368c-48ab-8235-533598af56c7 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:36 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:36 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 1073741824
Sep 29 16:48:36 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:37 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 1073741824" returned: 0 in 0.477s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:37 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7
Sep 29 16:48:37 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:37 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e3d395-243b-407c-97d5-1c96fce26b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a2d0c8-368c-48ab-8235-533598af56c7', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d14fd0-3a90-4ee4-94a0-c804ea97bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Volume volume-a6a2d0c8-368c-48ab-8235-533598af56c7 (a6a2d0c8-368c-48ab-8235-533598af56c7): created successfully
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d14fd0-3a90-4ee4-94a0-c804ea97bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (63e165d1-1043-4f55-b202-aaa7637a362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ccc9df47-7f01-465d-a0a9-cfa77ac08aff tempest-ProjectReaderTests-58714135 None] Created volume successfully.
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-a6a2d0c8-368c-48ab-8235-533598af56c7-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "cinder-a6a2d0c8-368c-48ab-8235-533598af56c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-quobyte-a6a2d0c8-368c-48ab-8235-533598af56c7" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-a6a2d0c8-368c-48ab-8235-533598af56c7" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1cfce4-2d26-462c-9b5d-1f100fba6e6b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:37 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7
Sep 29 16:48:37 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:38 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7" returned: 0 in 0.399s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:38 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7
Sep 29 16:48:38 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:38 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-a6a2d0c8-368c-48ab-8235-533598af56c7" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-a6a2d0c8-368c-48ab-8235-533598af56c7" released by "delete_volume" :: held 0.702s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Created reservations ['0d07cd2d-23ea-461d-93dc-300b9e3c6ac6', '89a8aa06-beff-4727-82f1-2e977c716f9f', '689b6fca-117b-40b6-8069-cb2c668682d3', '4138ee92-27ef-4617-a957-eb0eec50e10c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:38 devstack sudo[105950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:38 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:38 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Deleted volume successfully.
Sep 29 16:48:38 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-55e0ccb8-7d81-4ec6-8275-9e048e1d3282 tempest-ProjectReaderTests-58714135 None] Lock "cinder-a6a2d0c8-368c-48ab-8235-533598af56c7-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (6f39bf84-d77e-41f2-8f17-26b34ea974a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5879e880-95f4-4c83-b5ef-fb07343b45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5879e880-95f4-4c83-b5ef-fb07343b45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500997980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab42d1-9f79-4ceb-9a1a-76bbae11e349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:39Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d741662-c1b3-4c70-a17c-20b31b19138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d741662-c1b3-4c70-a17c-20b31b19138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b97f97-2c7e-44f6-9efe-ddf6e7a8da17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b97f97-2c7e-44f6-9efe-ddf6e7a8da17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ab42d1-9f79-4ceb-9a1a-76bbae11e349', 'volume_name': 'volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d80611b-a093-4436-8148-ae633e63f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d80611b-a093-4436-8148-ae633e63f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695411d0-1b7f-4aa1-bc59-27b6c7fe8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Volume 96ab42d1-9f79-4ceb-9a1a-76bbae11e349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349', 'volume_size': 1}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500997980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ab42d1-9f79-4ceb-9a1a-76bbae11e349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ff336b06942f2bece6075343d64be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:39Z,use_quota=True,user_id='fc11402209da46849928c8d493e530df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Creating volume 96ab42d1-9f79-4ceb-9a1a-76bbae11e349 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:39 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:39 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 1073741824
Sep 29 16:48:39 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:39 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 1073741824" returned: 0 in 0.507s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:39 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349
Sep 29 16:48:39 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:40 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" returned: 0 in 0.262s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695411d0-1b7f-4aa1-bc59-27b6c7fe8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff326b-fdee-4460-b349-732e13f35f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:40 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Volume volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 (96ab42d1-9f79-4ceb-9a1a-76bbae11e349): created successfully
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff326b-fdee-4460-b349-732e13f35f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Flow 'volume_create_manager' (6f39bf84-d77e-41f2-8f17-26b34ea974a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a0906922-e366-4414-a35b-468cf91f313b tempest-ProjectReaderTests-58714135 None] Created volume successfully.
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-96ab42d1-9f79-4ceb-9a1a-76bbae11e349-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "cinder-96ab42d1-9f79-4ceb-9a1a-76bbae11e349-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Acquiring lock "cinder-quobyte-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad19d5-b234-4b8a-86d6-17c15b731945]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:41 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349
Sep 29 16:48:41 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:41 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" returned: 0 in 0.391s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:41 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349
Sep 29 16:48:41 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:42 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" returned: 0 in 0.255s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "cinder-quobyte-96ab42d1-9f79-4ceb-9a1a-76bbae11e349" released by "delete_volume" :: held 0.711s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Created reservations ['39cefd86-07e9-4a46-9687-8b25827a9658', '3292c9bb-e61f-4ed9-a6af-3610d8626381', 'bf097af0-c3bc-44cc-9c64-7c5cf8472fa6', '5e76e17d-3f84-464e-b39e-543239e3cf0a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:42 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:42 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:42 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Deleted volume successfully.
Sep 29 16:48:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b406b434-2e8c-42fd-800b-0187e775ae06 tempest-ProjectReaderTests-58714135 None] Lock "cinder-96ab42d1-9f79-4ceb-9a1a-76bbae11e349-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Flow 'volume_create_manager' (de0a0552-1883-4b06-8125-5a5f9f7ed218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf9e543-58a2-453b-bdf7-b2943f02387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf9e543-58a2-453b-bdf7-b2943f02387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-657418397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ccdbec-3f32-4091-a342-0b1506a574a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9a41c1831d490b8487c3bdddcb36b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:45Z,use_quota=True,user_id='df0cc04b8bbb4bd192601f4130675e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e0b776-3a92-4365-b4d4-f734515a6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e0b776-3a92-4365-b4d4-f734515a6466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4675bbd1-4b8d-44f5-b58a-4e63d72fdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4675bbd1-4b8d-44f5-b58a-4e63d72fdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ccdbec-3f32-4091-a342-0b1506a574a8', 'volume_name': 'volume-e1ccdbec-3f32-4091-a342-0b1506a574a8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e64164-b426-4aa5-b506-142c04e8f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e64164-b426-4aa5-b506-142c04e8f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa5227f-0c3b-481d-9aa5-4d8e6031fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:44 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Volume e1ccdbec-3f32-4091-a342-0b1506a574a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ccdbec-3f32-4091-a342-0b1506a574a8', 'volume_size': 1}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-657418397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ccdbec-3f32-4091-a342-0b1506a574a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9a41c1831d490b8487c3bdddcb36b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:45Z,use_quota=True,user_id='df0cc04b8bbb4bd192601f4130675e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Creating volume e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:48:44 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:48:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:44 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 1073741824
Sep 29 16:48:44 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:45 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 1073741824" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:45 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:48:45 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:45 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.236s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa5227f-0c3b-481d-9aa5-4d8e6031fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ccdbec-3f32-4091-a342-0b1506a574a8', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e535b-4e92-45ae-a4fa-b77d8a83e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:48:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Volume volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 (e1ccdbec-3f32-4091-a342-0b1506a574a8): created successfully
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e535b-4e92-45ae-a4fa-b77d8a83e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:48:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Flow 'volume_create_manager' (de0a0552-1883-4b06-8125-5a5f9f7ed218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:48:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a7756ad0-8015-4822-9f73-e0c9991aece4 tempest-TestImageHashVerification-2056413828 None] Created volume successfully.
Sep 29 16:48:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004b52a-b34d-4750-b35c-328fe1f47567]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:46 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:48:46 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:47 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef820a9-96a6-44fb-8e76-74f836bded29]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:47 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:48:47 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:47 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.365s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 /opt/stack/data/cinder/conversion/e1ccdbec-3f32-4091-a342-0b1506a574a8.temp_image.378ac282-1c5c-41e6-975a-bab502cb5b64qr73t5tv.img {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:47 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 /opt/stack/data/cinder/conversion/e1ccdbec-3f32-4091-a342-0b1506a574a8.temp_image.378ac282-1c5c-41e6-975a-bab502cb5b64qr73t5tv.img
Sep 29 16:48:47 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:53 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 /opt/stack/data/cinder/conversion/e1ccdbec-3f32-4091-a342-0b1506a574a8.temp_image.378ac282-1c5c-41e6-975a-bab502cb5b64qr73t5tv.img" returned: 0 in 5.843s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d82dcf-2ad1-46d8-9c91-bca973866128]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:53 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:48:53 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:48:53 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:48:53 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:48:53 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.236s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:48:53 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.560s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:48:53 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/conversion/e1ccdbec-3f32-4091-a342-0b1506a574a8.temp_image.378ac282-1c5c-41e6-975a-bab502cb5b64qr73t5tv.img {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:48:53 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Converted 1024.00 MB image at 175.21 MB/s
Sep 29 16:48:54 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] 378ac282-1c5c-41e6-975a-bab502cb5b64 was raw, no need to convert to raw {{(pid=86843) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 16:49:04 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:49:04 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:DELETE=7,cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=76 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:49:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.035s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Uploaded volume to glance image-id: 378ac282-1c5c-41e6-975a-bab502cb5b64. {{(pid=86843) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 16:49:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-99fd63e0-35ab-4c74-8bc7-e8f36ede812d tempest-TestImageHashVerification-2056413828 None] Copy volume to image completed successfully.
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Acquiring lock "cinder-e1ccdbec-3f32-4091-a342-0b1506a574a8-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "cinder-e1ccdbec-3f32-4091-a342-0b1506a574a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Acquiring lock "cinder-quobyte-e1ccdbec-3f32-4091-a342-0b1506a574a8" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "cinder-quobyte-e1ccdbec-3f32-4091-a342-0b1506a574a8" acquired by "delete_volume" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0389b1f-f7c5-4bde-ab64-124eef51988c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:13 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:49:13 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:13 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:13 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8
Sep 29 16:49:13 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:13 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e1ccdbec-3f32-4091-a342-0b1506a574a8" returned: 0 in 0.244s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "cinder-quobyte-e1ccdbec-3f32-4091-a342-0b1506a574a8" released by "delete_volume" :: held 0.645s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:13 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Created reservations ['0eab5787-9174-4fa7-8e8a-ea4abccb86b9', 'fb489958-67e3-41a9-9616-eee906ea0d51', '4c193da1-dffc-41f5-8a2d-85484bef40c4', 'b65849b8-2c04-42cf-be56-7a46647cd02d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:14 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:14 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:14 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Deleted volume successfully.
Sep 29 16:49:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-0a588de4-398c-49a2-add8-f79d1c4eb034 tempest-TestImageHashVerification-2056413828 None] Lock "cinder-e1ccdbec-3f32-4091-a342-0b1506a574a8-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=3 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:49:30 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (64995a2c-400a-47ce-a530-6c2d671d0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273a3bfc-e958-4512-8cb9-956bd05c1e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273a3bfc-e958-4512-8cb9-956bd05c1e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437003105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2360034b-4443-40a3-9ec8-2b47436c22f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:34Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f8776f-fdcd-4c8c-a0d9-c149820e4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f8776f-fdcd-4c8c-a0d9-c149820e4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed495b77-451f-4a98-a205-ec52f4d71cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed495b77-451f-4a98-a205-ec52f4d71cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2360034b-4443-40a3-9ec8-2b47436c22f9', 'volume_name': 'volume-2360034b-4443-40a3-9ec8-2b47436c22f9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a064de7e-edb3-45a2-8a19-26edf672784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a064de7e-edb3-45a2-8a19-26edf672784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c893fda4-5b34-424f-8baa-99fc91face0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Volume 2360034b-4443-40a3-9ec8-2b47436c22f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2360034b-4443-40a3-9ec8-2b47436c22f9', 'volume_size': 1}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437003105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2360034b-4443-40a3-9ec8-2b47436c22f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:34Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Creating volume 2360034b-4443-40a3-9ec8-2b47436c22f9 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:34 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:34 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 1073741824
Sep 29 16:49:34 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (42ae625b-39dc-4656-acb2-86bed831749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ac66e-69b8-4274-9bf0-cf5e66a0cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ac66e-69b8-4274-9bf0-cf5e66a0cae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244348443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e4e812-1c02-48c1-ac45-0bc24fcac70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:35Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084e8114-b3b6-4c98-a722-c48336585a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084e8114-b3b6-4c98-a722-c48336585a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12c738e-6f78-4fd2-91ef-aa0ea378a6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12c738e-6f78-4fd2-91ef-aa0ea378a6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e4e812-1c02-48c1-ac45-0bc24fcac70f', 'volume_name': 'volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6b7dfc-1dbb-4a3d-ab74-3a6e6febaaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6b7dfc-1dbb-4a3d-ab74-3a6e6febaaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79b0ea-3402-46c0-96ff-59c45d5aa6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Volume f9e4e812-1c02-48c1-ac45-0bc24fcac70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f', 'volume_size': 1}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:35 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 1073741824" returned: 0 in 0.684s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (c4bc5695-fa9b-4cfe-971a-13265e467283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089a5b91-cc17-4914-a291-2197d64c0640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089a5b91-cc17-4914-a291-2197d64c0640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529862785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3351f70-43d4-4334-8c18-e98b0c30e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:35Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f939a374-c357-4a72-b4b9-517025f10ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f939a374-c357-4a72-b4b9-517025f10ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9d6fae-8ba4-4b69-8995-b4d233557591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9d6fae-8ba4-4b69-8995-b4d233557591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3351f70-43d4-4334-8c18-e98b0c30e9a3', 'volume_name': 'volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab88412-499e-423b-a50f-94d6c883f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab88412-499e-423b-a50f-94d6c883f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c085f1-a73d-4d4b-8a7b-37f281686b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume f3351f70-43d4-4334-8c18-e98b0c30e9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3', 'volume_size': 1}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:35 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9
Sep 29 16:49:35 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:35 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9" returned: 0 in 0.341s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244348443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e4e812-1c02-48c1-ac45-0bc24fcac70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:35Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Creating volume f9e4e812-1c02-48c1-ac45-0bc24fcac70f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:35 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c893fda4-5b34-424f-8baa-99fc91face0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2360034b-4443-40a3-9ec8-2b47436c22f9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c938b434-df08-402f-9999-e87e29e80b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f 1073741824
Sep 29 16:49:35 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (95e3ca31-fb63-4b68-a005-e3d200c435c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b9c1d2-bf89-41fb-912f-c9919a885f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b9c1d2-bf89-41fb-912f-c9919a885f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-197364382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097f37b3-d9e0-4829-b01f-ec243eb38051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:36Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39360a-95df-43f8-9934-a995c3de38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39360a-95df-43f8-9934-a995c3de38cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56db4525-2230-445b-bffc-c66257998911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56db4525-2230-445b-bffc-c66257998911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097f37b3-d9e0-4829-b01f-ec243eb38051', 'volume_name': 'volume-097f37b3-d9e0-4829-b01f-ec243eb38051', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b247f54-2b47-4687-9c18-ed86c6ef7c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b247f54-2b47-4687-9c18-ed86c6ef7c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079d013e-2c29-449f-8f57-4e8cb96298b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Volume 097f37b3-d9e0-4829-b01f-ec243eb38051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097f37b3-d9e0-4829-b01f-ec243eb38051', 'volume_size': 1}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Volume volume-2360034b-4443-40a3-9ec8-2b47436c22f9 (2360034b-4443-40a3-9ec8-2b47436c22f9): created successfully
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c938b434-df08-402f-9999-e87e29e80b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (64995a2c-400a-47ce-a530-6c2d671d0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:36 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-419cfb10-57c5-4914-a0f7-a7667af1628b tempest-CreateVolumesFromImageTest-2134073128 None] Created volume successfully.
Sep 29 16:49:36 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f 1073741824" returned: 0 in 0.601s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:36 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f
Sep 29 16:49:36 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (c8abbf9f-1058-4a14-b186-0e817a4fc938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d46bee-de21-44b1-b5b7-381a78967510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d46bee-de21-44b1-b5b7-381a78967510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150925631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09483f1e-9008-4d40-9237-de643dca73a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:37Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e7ddb4-07c1-4ced-99db-6e47d7b90766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e7ddb4-07c1-4ced-99db-6e47d7b90766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abdfa1c-a7e0-4daf-9d2b-74eff871cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abdfa1c-a7e0-4daf-9d2b-74eff871cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09483f1e-9008-4d40-9237-de643dca73a3', 'volume_name': 'volume-09483f1e-9008-4d40-9237-de643dca73a3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c01f35-dbd8-4a5f-86cc-b1ac2224c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c01f35-dbd8-4a5f-86cc-b1ac2224c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a51300-487e-45f9-9eef-22ccbe27dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Volume 09483f1e-9008-4d40-9237-de643dca73a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09483f1e-9008-4d40-9237-de643dca73a3', 'volume_size': 1}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:36 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529862785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3351f70-43d4-4334-8c18-e98b0c30e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:35Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:36 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:36 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 1073741824
Sep 29 16:49:36 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (0b54b559-86b0-4429-8c4e-3cd59201b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4075e3fd-66d2-4260-ab54-5c34a16a21e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79b0ea-3402-46c0-96ff-59c45d5aa6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:36 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067d389-6483-4b72-8794-6778d0d3ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4075e3fd-66d2-4260-ab54-5c34a16a21e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108957002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a17e741-5684-44c9-a378-1ae9997ab94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:37Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75bdb66-286a-4cd5-968c-7da1c1c294ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75bdb66-286a-4cd5-968c-7da1c1c294ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d6468-0752-4449-85a7-a2e8e6bfebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817d6468-0752-4449-85a7-a2e8e6bfebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a17e741-5684-44c9-a378-1ae9997ab94e', 'volume_name': 'volume-3a17e741-5684-44c9-a378-1ae9997ab94e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1e4133-da81-4788-8e9f-0cb956eb1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1e4133-da81-4788-8e9f-0cb956eb1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b775024-7dee-4833-9014-e142350a00fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Volume 3a17e741-5684-44c9-a378-1ae9997ab94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a17e741-5684-44c9-a378-1ae9997ab94e', 'volume_size': 1}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Volume volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f (f9e4e812-1c02-48c1-ac45-0bc24fcac70f): created successfully
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f067d389-6483-4b72-8794-6778d0d3ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (42ae625b-39dc-4656-acb2-86bed831749c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c00a49d9-496e-4c88-8700-f9bf0306be2c tempest-CreateVolumesFromImageTest-2134073128 None] Created volume successfully.
Sep 29 16:49:37 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 1073741824" returned: 0 in 0.523s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:37 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3
Sep 29 16:49:37 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:37 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3" returned: 0 in 0.367s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-197364382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097f37b3-d9e0-4829-b01f-ec243eb38051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:36Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Creating volume 097f37b3-d9e0-4829-b01f-ec243eb38051 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c085f1-a73d-4d4b-8a7b-37f281686b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 1073741824
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947c3997-66e6-4929-b2b4-e56df5abef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:37 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 (f3351f70-43d4-4334-8c18-e98b0c30e9a3): created successfully
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947c3997-66e6-4929-b2b4-e56df5abef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (c4bc5695-fa9b-4cfe-971a-13265e467283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58f32e2a-9d5f-4d64-813a-bceb12341250 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:38 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 1073741824" returned: 0 in 0.593s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:38 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051
Sep 29 16:49:38 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:38 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1150925631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09483f1e-9008-4d40-9237-de643dca73a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:37Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Creating volume 09483f1e-9008-4d40-9237-de643dca73a3 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:38 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079d013e-2c29-449f-8f57-4e8cb96298b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097f37b3-d9e0-4829-b01f-ec243eb38051', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:38 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 1073741824
Sep 29 16:49:38 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fec7c51-12b1-4026-9b3b-36c8588e6ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Volume volume-097f37b3-d9e0-4829-b01f-ec243eb38051 (097f37b3-d9e0-4829-b01f-ec243eb38051): created successfully
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fec7c51-12b1-4026-9b3b-36c8588e6ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (95e3ca31-fb63-4b68-a005-e3d200c435c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cac4224c-b95d-490d-9999-49e7979fc20e tempest-CreateVolumesFromImageTest-2134073128 None] Created volume successfully.
Sep 29 16:49:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Flow 'volume_create_manager' (f1d0593f-9e3a-410f-a914-c3f435f2e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ee7b8-c437-4e8f-9bb2-ae3ff03ed46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ee7b8-c437-4e8f-9bb2-ae3ff03ed46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d6249e-2864-41db-8e38-5c6d3701f420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268534d3cc6e42e5a1f50a876f68d10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:39Z,use_quota=True,user_id='e5c8a1d425834fe1a8c91535c96d4035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59496c46-1ba9-4f69-aaeb-fa36de348c95),volume_type_id=59496c46-1ba9-4f69-aaeb-fa36de348c95)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c88f471-5cdd-4b3c-a1dc-c390c052c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c88f471-5cdd-4b3c-a1dc-c390c052c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6be4110-584a-42bc-b887-f2c717e32430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:49:39 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 1073741824" returned: 0 in 0.543s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:39 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3
Sep 29 16:49:39 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6be4110-584a-42bc-b887-f2c717e32430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00d6249e-2864-41db-8e38-5c6d3701f420', 'volume_name': 'volume-00d6249e-2864-41db-8e38-5c6d3701f420', 'volume_size': 1, 'image_id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8807619477081550eb3308b5604193b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268534d3cc6e42e5a1f50a876f68d10c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0b162b18c7f1195be0ecea4a0adc33ee5ff95b7f08c3cd19e9b9a9d2b5540596922330b399be49386f32a134971a53e68aafa961fda63649f9994a23dd9a904', 'id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'created_at': datetime.datetime(2026, 9, 29, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7e88860>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad7c34f-6346-4e71-bec9-a09934dd0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad7c34f-6346-4e71-bec9-a09934dd0090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41ce495-0291-46de-8036-3278c9cb3ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Volume 00d6249e-2864-41db-8e38-5c6d3701f420: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00d6249e-2864-41db-8e38-5c6d3701f420', 'volume_size': 1, 'image_id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8807619477081550eb3308b5604193b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268534d3cc6e42e5a1f50a876f68d10c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0b162b18c7f1195be0ecea4a0adc33ee5ff95b7f08c3cd19e9b9a9d2b5540596922330b399be49386f32a134971a53e68aafa961fda63649f9994a23dd9a904', 'id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'created_at': datetime.datetime(2026, 9, 29, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7e88860>}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Trying to clone 00d6249e-2864-41db-8e38-5c6d3701f420 from image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:49:39 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108957002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a17e741-5684-44c9-a378-1ae9997ab94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1e6262101b4155bf1168a0fb9ea980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:37Z,use_quota=True,user_id='1a8cff1aaa2943fc8384d6e998915f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Creating volume 3a17e741-5684-44c9-a378-1ae9997ab94e {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:39 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a51300-487e-45f9-9eef-22ccbe27dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09483f1e-9008-4d40-9237-de643dca73a3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e 1073741824
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c6a795-3964-48d6-9619-e1b9c1e7d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:39 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:49:39 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 16:49:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Volume volume-09483f1e-9008-4d40-9237-de643dca73a3 (09483f1e-9008-4d40-9237-de643dca73a3): created successfully
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c6a795-3964-48d6-9619-e1b9c1e7d436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (c8abbf9f-1058-4a14-b186-0e817a4fc938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4877466e-643a-488b-9e3f-d877595b51b5 tempest-CreateVolumesFromImageTest-2134073128 None] Created volume successfully.
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b315a0-9453-485d-9fbc-8ccbaa50977d]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:39 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:39 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:40 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:40 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e 1073741824" returned: 0 in 0.605s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:40 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:40 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:40 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e
Sep 29 16:49:40 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:40 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Temporary image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 is fetched for user e5c8a1d425834fe1a8c91535c96d4035. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:49:40 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e" returned: 0 in 0.253s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.611s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating offline snapshot ea6830ff-c048-4276-a5d5-74917553973a of volume f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b775024-7dee-4833-9014-e142350a00fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a17e741-5684-44c9-a378-1ae9997ab94e', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b099d04f-40e0-4736-a881-3d2cb48646c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ee9d4f-2b5c-46dc-977f-b3b5007ded4c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:40 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Volume volume-3a17e741-5684-44c9-a378-1ae9997ab94e (3a17e741-5684-44c9-a378-1ae9997ab94e): created successfully
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b099d04f-40e0-4736-a881-3d2cb48646c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Flow 'volume_create_manager' (0b54b559-86b0-4429-8c4e-3cd59201b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359ce64-21b1-4e29-9dee-579e3b612e26]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:40 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5d19586a-dd4b-40d6-866b-da7fee40e5ae tempest-CreateVolumesFromImageTest-2134073128 None] Created volume successfully.
Sep 29 16:49:40 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3
Sep 29 16:49:40 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:40 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:40 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:40 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:41 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:41 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a 1G
Sep 29 16:49:41 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:41 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:41 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:41 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:41 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a 1G" returned: 0 in 0.474s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:41 devstack sudo[106205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a
Sep 29 16:49:41 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-3a17e741-5684-44c9-a378-1ae9997ab94e-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-3a17e741-5684-44c9-a378-1ae9997ab94e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-quobyte-3a17e741-5684-44c9-a378-1ae9997ab94e" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-3a17e741-5684-44c9-a378-1ae9997ab94e" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd81285-36b2-4a46-ad59-a16c71c76dbe]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:41 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a" returned: 0 in 0.314s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:41 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a is being set with open permissions: ugo+rw
Sep 29 16:49:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:41 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a
Sep 29 16:49:41 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:41 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e
Sep 29 16:49:41 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a" returned: 0 in 0.282s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:42 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:42 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info
Sep 29 16:49:42 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e
Sep 29 16:49:42 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info is being set with open permissions: ugo+rw
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:42 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3a17e741-5684-44c9-a378-1ae9997ab94e" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info
Sep 29 16:49:42 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-3a17e741-5684-44c9-a378-1ae9997ab94e" released by "delete_volume" :: held 0.741s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Created reservations ['a22c1c48-1f86-4903-b230-0c8d3c7c3868', 'ab8185b8-b0cf-46c0-b8c6-eabbdda99d72', 'c3770635-9c4f-499d-926f-adb66e76b1e8', 'a7f31cd5-451b-4612-8096-bd412ea244c4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:42 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:42 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.info" returned: 0 in 0.343s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d6249e-2864-41db-8e38-5c6d3701f420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268534d3cc6e42e5a1f50a876f68d10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:39Z,use_quota=True,user_id='e5c8a1d425834fe1a8c91535c96d4035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59496c46-1ba9-4f69-aaeb-fa36de348c95),volume_type_id=59496c46-1ba9-4f69-aaeb-fa36de348c95)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Creating volume 00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:42 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-09483f1e-9008-4d40-9237-de643dca73a3-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:42 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1073741824
Sep 29 16:49:42 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-899a5c13-1f5f-4580-b5d7-8651abcab1a1 tempest-CreateVolumesFromSnapshotTest-261690805 None] Create snapshot completed successfully
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-09483f1e-9008-4d40-9237-de643dca73a3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-quobyte-09483f1e-9008-4d40-9237-de643dca73a3" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-09483f1e-9008-4d40-9237-de643dca73a3" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:42 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.388s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Deleted volume successfully.
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23d070-9625-4f5d-b243-c040f952a6fb]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ee32e725-892a-430e-8e2a-4a9815a44558 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-3a17e741-5684-44c9-a378-1ae9997ab94e-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:43 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3
Sep 29 16:49:43 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:43 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1073741824" returned: 0 in 0.619s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:43 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420
Sep 29 16:49:43 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:43 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3" returned: 0 in 0.578s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:43 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3
Sep 29 16:49:43 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:43 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420" returned: 0 in 0.318s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Attempting download of ce7f7e46-0fd3-4f42-9518-1e24170c65c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}])) to volume 00d6249e-2864-41db-8e38-5c6d3701f420. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (116e02d3-5513-44d7-89e4-eae1d3926d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a61e18-0244-4ad5-a1db-233a34b1bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:43 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-09483f1e-9008-4d40-9237-de643dca73a3" returned: 0 in 0.390s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a61e18-0244-4ad5-a1db-233a34b1bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479430808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d945857-ced4-41da-9863-e6f2149a5209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:44Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dc9344-0467-4e23-9607-1b9e83b64709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dc9344-0467-4e23-9607-1b9e83b64709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1e2f40-ed38-422c-abb4-39b7271830bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1e2f40-ed38-422c-abb4-39b7271830bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d945857-ced4-41da-9863-e6f2149a5209', 'volume_name': 'volume-3d945857-ced4-41da-9863-e6f2149a5209', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3218a8-0483-489a-8aed-84d84dd2a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3218a8-0483-489a-8aed-84d84dd2a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba17ef12-93e3-4bdd-baef-62daa0df50aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume 3d945857-ced4-41da-9863-e6f2149a5209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d945857-ced4-41da-9863-e6f2149a5209', 'volume_size': 1}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479430808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d945857-ced4-41da-9863-e6f2149a5209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:44Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume 3d945857-ced4-41da-9863-e6f2149a5209 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:44 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-09483f1e-9008-4d40-9237-de643dca73a3" released by "delete_volume" :: held 1.129s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0faa4-ba65-4e83-8e40-59d825ff1254]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:44 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 1073741824
Sep 29 16:49:44 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Created reservations ['0ef5bab3-5ce1-4022-a3b5-4a5efd0f3d04', '59b04912-6c95-447d-bc32-cf08fe0c2a59', '77c0149c-508f-49f8-9e6f-7b37b6289163', '60952c5c-b002-49d4-b87a-3c3143f32b01'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:44 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip
Sep 29 16:49:44 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:44 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:44 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (7f9a68c4-3882-481e-b9de-9766c08325e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4955fd-488b-4778-b005-634b3b02d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4955fd-488b-4778-b005-634b3b02d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1057082571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:44Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da30c6f6-a8cc-4f0a-a682-eee55a2d63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da30c6f6-a8cc-4f0a-a682-eee55a2d63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0cf7a8-1de2-4351-a37c-0023885f29c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0cf7a8-1de2-4351-a37c-0023885f29c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2', 'volume_name': 'volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a2f54-1f8e-406b-aed6-1c4a34cff8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a2f54-1f8e-406b-aed6-1c4a34cff8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:44 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4695bc2c-30b3-48b4-8398-10e89c89a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:44 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume 0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2', 'volume_size': 1}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip" returned: 0 in 0.584s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:44 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.365s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:44 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Deleted volume successfully.
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48852c99-9043-4c7e-bd1d-b83adbbf15f7 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-09483f1e-9008-4d40-9237-de643dca73a3-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:44 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip
Sep 29 16:49:44 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:44 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 1073741824" returned: 0 in 0.799s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:44 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209
Sep 29 16:49:44 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (6c733696-36ef-40d6-b9f8-4b29d62bdd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b668f4-483f-476a-8b32-2ab5af4bb978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip" returned: 1 in 0.454s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_a18cseip' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b668f4-483f-476a-8b32-2ab5af4bb978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649339616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d979ff-4df2-4a0f-96d1-02b62eff0fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:45Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d529e5a0-3597-471f-8189-06af62e4d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d529e5a0-3597-471f-8189-06af62e4d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6afacd-bf10-4899-a68e-d56fac4aace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6afacd-bf10-4899-a68e-d56fac4aace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d979ff-4df2-4a0f-96d1-02b62eff0fd5', 'volume_name': 'volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5793a12-1e21-4793-9690-009ae3afde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5793a12-1e21-4793-9690-009ae3afde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad92786-a2b2-42b9-8229-6a9db0268192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume 54d979ff-4df2-4a0f-96d1-02b62eff0fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5', 'volume_size': 1}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cd0310-84c2-41cd-8f0f-45ad36e98f80]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-097f37b3-d9e0-4829-b01f-ec243eb38051-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-097f37b3-d9e0-4829-b01f-ec243eb38051-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-quobyte-097f37b3-d9e0-4829-b01f-ec243eb38051" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-097f37b3-d9e0-4829-b01f-ec243eb38051" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[38555c51-0db9-4bea-bbfb-5fabc7eddd52]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:45 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209" returned: 0 in 0.476s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1057082571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:44Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume 0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:45 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba17ef12-93e3-4bdd-baef-62daa0df50aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d945857-ced4-41da-9863-e6f2149a5209', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4ba157-a461-44de-95fa-cce25cc4f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:45 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:45 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 1073741824
Sep 29 16:49:45 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-3d945857-ced4-41da-9863-e6f2149a5209 (3d945857-ced4-41da-9863-e6f2149a5209): created successfully
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4ba157-a461-44de-95fa-cce25cc4f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (116e02d3-5513-44d7-89e4-eae1d3926d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-40120268-6ff9-4f71-8ed3-93b8e6703153 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:45 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051
Sep 29 16:49:45 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (e76e1511-8888-4b90-a628-a0770c94c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5ccd8-8b47-463f-a397-fa7bf29a4c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad5ccd8-8b47-463f-a397-fa7bf29a4c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516211672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf28b764-e2e5-4ebd-9e32-b9e253645557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:45Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e2fddd-5b86-4fa7-9ed9-4a0fa44dedc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e2fddd-5b86-4fa7-9ed9-4a0fa44dedc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5c36a7-35a4-4c2e-bf6c-c582eadc89b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5c36a7-35a4-4c2e-bf6c-c582eadc89b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf28b764-e2e5-4ebd-9e32-b9e253645557', 'volume_name': 'volume-bf28b764-e2e5-4ebd-9e32-b9e253645557', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df14f922-8553-4c50-8598-bce6690b2b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df14f922-8553-4c50-8598-bce6690b2b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d4c369-cd4b-49af-9f36-7d1dcdb4134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:45 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume bf28b764-e2e5-4ebd-9e32-b9e253645557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf28b764-e2e5-4ebd-9e32-b9e253645557', 'volume_size': 1}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:45 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051" returned: 0 in 0.577s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:45 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:45 devstack sudo[106282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051
Sep 29 16:49:45 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:46 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD
Sep 29 16:49:46 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:46 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 1073741824" returned: 0 in 0.783s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:46 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:46 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2
Sep 29 16:49:46 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-097f37b3-d9e0-4829-b01f-ec243eb38051" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-097f37b3-d9e0-4829-b01f-ec243eb38051" released by "delete_volume" :: held 1.060s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (75eb8d9a-ab9b-4cb3-b074-e8e4d18b2e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeea109-0785-44f6-bd4e-70868786be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeea109-0785-44f6-bd4e-70868786be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660731135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f63beb-e2de-413b-9c0c-cd6504667625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:46Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a186fe86-005b-4f62-9dcd-7b8828ecd817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a186fe86-005b-4f62-9dcd-7b8828ecd817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b7e33a-1af7-4a4e-a103-24c5bba7edde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b7e33a-1af7-4a4e-a103-24c5bba7edde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f63beb-e2de-413b-9c0c-cd6504667625', 'volume_name': 'volume-97f63beb-e2de-413b-9c0c-cd6504667625', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee10b1b-e63d-4988-8ea9-3dffc11ae21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee10b1b-e63d-4988-8ea9-3dffc11ae21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13fb06-31df-44dd-bd14-3a1ff00ac6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume 97f63beb-e2de-413b-9c0c-cd6504667625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f63beb-e2de-413b-9c0c-cd6504667625', 'volume_size': 1}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:46 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD" returned: 1 in 0.570s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] ce7f7e46-0fd3-4f42-9518-1e24170c65c4 was raw, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:46 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:46 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" returned: 0 in 0.353s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:46 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649339616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d979ff-4df2-4a0f-96d1-02b62eff0fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:45Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume 54d979ff-4df2-4a0f-96d1-02b62eff0fd5 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:46 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Created reservations ['540639d7-278d-4c2d-9a9e-8818fc3dde9b', '9a2c80b4-f21e-4150-b830-0c885a6919e7', 'a2bb70f2-f618-4d9f-9385-01b1192d1977', 'ec9eb79a-7bce-415c-a11c-932b07bb86bf'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:46 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 1073741824
Sep 29 16:49:46 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4695bc2c-30b3-48b4-8398-10e89c89a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73bb48d-eacf-40b4-ad4a-8f950365d06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 (0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2): created successfully
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73bb48d-eacf-40b4-ad4a-8f950365d06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (7f9a68c4-3882-481e-b9de-9766c08325e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac5d62c6-30ae-4509-96e1-e989054fb847 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:46 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:46 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:47 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420" returned: 0 in 0.645s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce7f7e46-0fd3-4f42-9518-1e24170c65c4_965ihurtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:47 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.354s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:47 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Deleted volume successfully.
Sep 29 16:49:47 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1G
Sep 29 16:49:47 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 1073741824" returned: 0 in 0.623s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-77159427-d1c2-4ed7-8484-943903089515 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-097f37b3-d9e0-4829-b01f-ec243eb38051-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:47 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5
Sep 29 16:49:47 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-f9e4e812-1c02-48c1-ac45-0bc24fcac70f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-f9e4e812-1c02-48c1-ac45-0bc24fcac70f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:47 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 1G" returned: 0 in 0.422s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Downloaded image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}])) to volume 00d6249e-2864-41db-8e38-5c6d3701f420 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Temporary image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 for user e5c8a1d425834fe1a8c91535c96d4035 is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Marking volume 00d6249e-2864-41db-8e38-5c6d3701f420 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Copying metadata from image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 to 00d6249e-2864-41db-8e38-5c6d3701f420. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Creating volume glance metadata for volume 00d6249e-2864-41db-8e38-5c6d3701f420 backed by image ce7f7e46-0fd3-4f42-9518-1e24170c65c4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f8807619477081550eb3308b5604193b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-quobyte-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:47 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516211672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf28b764-e2e5-4ebd-9e32-b9e253645557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:45Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume bf28b764-e2e5-4ebd-9e32-b9e253645557 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b634c20c-625f-4541-be44-d2742033f80f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:47 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 1073741824
Sep 29 16:49:47 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad92786-a2b2-42b9-8229-6a9db0268192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a5ae2-c30c-4546-9578-3f49e2566a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 (54d979ff-4df2-4a0f-96d1-02b62eff0fd5): created successfully
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a5ae2-c30c-4546-9578-3f49e2566a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (6c733696-36ef-40d6-b9f8-4b29d62bdd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-60556c52-6eac-4a10-8355-4c36b7047fe5 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:47 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f
Sep 29 16:49:47 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41ce495-0291-46de-8036-3278c9cb3ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d6249e-2864-41db-8e38-5c6d3701f420', 'volume_size': 1, 'image_id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8807619477081550eb3308b5604193b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268534d3cc6e42e5a1f50a876f68d10c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0b162b18c7f1195be0ecea4a0adc33ee5ff95b7f08c3cd19e9b9a9d2b5540596922330b399be49386f32a134971a53e68aafa961fda63649f9994a23dd9a904', 'id': 'ce7f7e46-0fd3-4f42-9518-1e24170c65c4', 'created_at': datetime.datetime(2026, 9, 29, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce7f7e46-0fd3-4f42-9518-1e24170c65c4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560f7e88860>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ad6da-6d78-48af-bd40-072929fc527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Volume volume-00d6249e-2864-41db-8e38-5c6d3701f420 (00d6249e-2864-41db-8e38-5c6d3701f420): created successfully
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ad6da-6d78-48af-bd40-072929fc527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:47 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Flow 'volume_create_manager' (f1d0593f-9e3a-410f-a914-c3f435f2e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-883a9c94-017e-4cbd-85ee-787ec13d7a43 tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Created volume successfully.
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Acquiring lock "cinder-00d6249e-2864-41db-8e38-5c6d3701f420-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:48 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" returned: 0 in 0.487s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f
Sep 29 16:49:48 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:48 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "cinder-00d6249e-2864-41db-8e38-5c6d3701f420-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 1073741824" returned: 0 in 0.569s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Acquiring lock "cinder-quobyte-00d6249e-2864-41db-8e38-5c6d3701f420" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "cinder-quobyte-00d6249e-2864-41db-8e38-5c6d3701f420" acquired by "delete_volume" :: waited 0.035s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:48 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557
Sep 29 16:49:48 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d9618-0dc3-4ca4-87f8-8e2870f3ca98]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420
Sep 29 16:49:48 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:48 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-f9e4e812-1c02-48c1-ac45-0bc24fcac70f" released by "delete_volume" :: held 0.916s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:48 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660731135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f63beb-e2de-413b-9c0c-cd6504667625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902e87473974d46b45af14e6afd6723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:46Z,use_quota=True,user_id='5334577240b3493ba3a7d0c794db85fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Creating volume 97f63beb-e2de-413b-9c0c-cd6504667625 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:48 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Created reservations ['e7b1cb1f-a2c0-470f-81ef-c342523c3b85', 'b8f6f685-3db9-417f-a547-9b74701bb7ca', 'eb94be79-fbae-4f3e-a4ed-f28c3e040d17', 'fc5a5707-c5f7-48a7-801c-f866b2c7aa3e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:48 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 1073741824
Sep 29 16:49:48 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d4c369-cd4b-49af-9f36-7d1dcdb4134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf28b764-e2e5-4ebd-9e32-b9e253645557', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fe376d-a669-4ef4-a36c-197c8bea8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:48 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 (bf28b764-e2e5-4ebd-9e32-b9e253645557): created successfully
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fe376d-a669-4ef4-a36c-197c8bea8406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (e76e1511-8888-4b90-a628-a0770c94c644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-18712d5a-2189-48a1-af42-d0dec024cdef tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:48 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:48 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420" returned: 0 in 0.539s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:48 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420
Sep 29 16:49:48 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:49 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.404s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Deleted volume successfully.
Sep 29 16:49:49 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-00d6249e-2864-41db-8e38-5c6d3701f420" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "cinder-quobyte-00d6249e-2864-41db-8e38-5c6d3701f420" released by "delete_volume" :: held 0.970s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ea0ac426-b9a1-4749-bd62-fbb257831701 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-f9e4e812-1c02-48c1-ac45-0bc24fcac70f-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Created reservations ['f412e43b-4458-4fcb-b2a4-3d1b4ed4874b', '9a91073f-913b-4b53-a4bb-4976eebc27c5', 'cfa64f29-4098-4ecb-87ee-71a982457d88', 'deb20e22-5179-4808-9cb1-92e7ab41f183'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:49 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 1073741824" returned: 0 in 0.725s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:49 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625
Sep 29 16:49:49 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:49 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:49 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:49 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625" returned: 0 in 0.321s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:49 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13fb06-31df-44dd-bd14-3a1ff00ac6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f63beb-e2de-413b-9c0c-cd6504667625', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574d2357-27b2-4961-9bec-e0d09657f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.324s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Deleted volume successfully.
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-2360034b-4443-40a3-9ec8-2b47436c22f9-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:49 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Volume volume-97f63beb-e2de-413b-9c0c-cd6504667625 (97f63beb-e2de-413b-9c0c-cd6504667625): created successfully
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574d2357-27b2-4961-9bec-e0d09657f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Flow 'volume_create_manager' (75eb8d9a-ab9b-4cb3-b074-e8e4d18b2e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-2360034b-4443-40a3-9ec8-2b47436c22f9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62a2295a-af38-4afd-bb2d-c7d56eeab27d tempest-VolumeAndVolumeTypeFromImageTest-901413907 None] Lock "cinder-00d6249e-2864-41db-8e38-5c6d3701f420-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-77adc10e-77ca-40c5-8ac0-4d72083be8af tempest-CreateVolumesFromSnapshotTest-261690805 None] Created volume successfully.
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "cinder-quobyte-2360034b-4443-40a3-9ec8-2b47436c22f9" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-2360034b-4443-40a3-9ec8-2b47436c22f9" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc749a5-ab63-4351-be6a-acac712d53ba]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:50 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9
Sep 29 16:49:50 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:50 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9" returned: 0 in 0.380s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:50 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9
Sep 29 16:49:50 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:50 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2360034b-4443-40a3-9ec8-2b47436c22f9" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-quobyte-2360034b-4443-40a3-9ec8-2b47436c22f9" released by "delete_volume" :: held 0.713s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Created reservations ['5850a831-d89f-476b-882c-ee81219a1452', '3f5a43b0-fdc1-470f-ad52-2b51198c8683', 'ba8604a9-344d-4ece-bc29-29b464503931', '3d6048e5-873b-4609-926c-db2c2fdc2d8d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:50 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:50 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-97f63beb-e2de-413b-9c0c-cd6504667625-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-97f63beb-e2de-413b-9c0c-cd6504667625-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-97f63beb-e2de-413b-9c0c-cd6504667625" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-97f63beb-e2de-413b-9c0c-cd6504667625" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:51 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6437f7-f084-4759-b124-44ff904bd4cb]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Deleted volume successfully.
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-636c3690-f377-4823-8c76-7a1f232e4b66 tempest-CreateVolumesFromImageTest-2134073128 None] Lock "cinder-2360034b-4443-40a3-9ec8-2b47436c22f9-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:51 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625
Sep 29 16:49:51 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:51 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625" returned: 0 in 0.380s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:51 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625
Sep 29 16:49:51 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:51 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-97f63beb-e2de-413b-9c0c-cd6504667625" returned: 0 in 0.301s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-97f63beb-e2de-413b-9c0c-cd6504667625" released by "delete_volume" :: held 0.742s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:51 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['b5c33bf8-7a6b-4a2b-a646-7206d1004c6d', '2cda96d2-54ca-41c6-8e5b-77b1bc8f4cee', '0fc9f426-2f52-46d7-a7f5-ca2429d1b8ca', 'e8dec944-a62c-4f42-b669-12046891c290'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:52 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:52 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-bf28b764-e2e5-4ebd-9e32-b9e253645557-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-bf28b764-e2e5-4ebd-9e32-b9e253645557-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-bf28b764-e2e5-4ebd-9e32-b9e253645557" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-bf28b764-e2e5-4ebd-9e32-b9e253645557" acquired by "delete_volume" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:52 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.415s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cdeaf0-e0a4-4708-b28e-91857c6f0a55]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2b37479c-2b20-4b3a-b8ee-d7ebd2a2704a tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-97f63beb-e2de-413b-9c0c-cd6504667625-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:52 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557
Sep 29 16:49:52 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:53 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557" returned: 0 in 0.552s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:53 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557
Sep 29 16:49:53 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:53 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-bf28b764-e2e5-4ebd-9e32-b9e253645557" returned: 0 in 0.300s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-bf28b764-e2e5-4ebd-9e32-b9e253645557" released by "delete_volume" :: held 0.939s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['3584b400-4bc0-4f05-a22a-437c01652d51', '35ce06d0-b15f-42e5-9550-52a25426dd73', 'c6a071ef-1ed0-4a20-9f59-4cf34d8b9123', '904f26c1-5b8a-4419-b533-ef58abc7756d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:53 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:53 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:53 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:53 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:53 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:49:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:49:54 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.411s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-fd95d9a0-ce2a-4ebf-9413-b24e4ee4e665 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-bf28b764-e2e5-4ebd-9e32-b9e253645557-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-54d979ff-4df2-4a0f-96d1-02b62eff0fd5-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-54d979ff-4df2-4a0f-96d1-02b62eff0fd5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[034c5a28-57ec-4f2c-9773-9a1ac98c4e38]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:54 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5
Sep 29 16:49:54 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:55 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:55 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5
Sep 29 16:49:55 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:55 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" returned: 0 in 0.364s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-54d979ff-4df2-4a0f-96d1-02b62eff0fd5" released by "delete_volume" :: held 0.835s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['e41949db-8807-4d56-8f1b-c7a5a56a082f', 'ca576192-1ac1-45e9-abfe-225153fd74fe', 'de3b8a92-bb00-4275-80fc-5d605aeab4ed', '4db801ad-2485-4ac2-bff6-73d6b5388948'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:55 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:55 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Flow 'volume_create_manager' (2072f6ec-fff1-40e3-9750-6d7ef8bc6d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298a92f9-da2a-4b16-9350-05552b56680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298a92f9-da2a-4b16-9350-05552b56680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1932785436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdbf072-e07f-410e-9681-8265056a1423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0cee3b10574aa59cdbad6e170d6b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:56Z,use_quota=True,user_id='d80323ae386640848947c4f55da0d0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a0a96a-dfc6-4e39-ab43-8ef06875a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a0a96a-dfc6-4e39-ab43-8ef06875a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357b1067-d120-4c09-b44c-2dc2be5e87aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357b1067-d120-4c09-b44c-2dc2be5e87aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdbf072-e07f-410e-9681-8265056a1423', 'volume_name': 'volume-1fdbf072-e07f-410e-9681-8265056a1423', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04342c6-9d2f-4308-aa91-a0e85ed54872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04342c6-9d2f-4308-aa91-a0e85ed54872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:55 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed9cb93-946a-41da-8b13-8b08833d5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:56 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Volume 1fdbf072-e07f-410e-9681-8265056a1423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdbf072-e07f-410e-9681-8265056a1423', 'volume_size': 1}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1932785436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdbf072-e07f-410e-9681-8265056a1423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0cee3b10574aa59cdbad6e170d6b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:56Z,use_quota=True,user_id='d80323ae386640848947c4f55da0d0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Creating volume 1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:56 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:56 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 1073741824
Sep 29 16:49:56 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611dfaf-6cfb-470f-a7bf-e1d85948bf25]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:56 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.477s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-7500bade-cfa7-4a61-b969-02bd1785e1a0 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-54d979ff-4df2-4a0f-96d1-02b62eff0fd5-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:56 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2
Sep 29 16:49:56 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:56 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 1073741824" returned: 0 in 0.670s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:56 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:49:56 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:56 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" returned: 0 in 0.599s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:56 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2
Sep 29 16:49:56 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:57 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed9cb93-946a-41da-8b13-8b08833d5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdbf072-e07f-410e-9681-8265056a1423', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449837ab-fd6c-4e51-9c1a-edb371422f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Volume volume-1fdbf072-e07f-410e-9681-8265056a1423 (1fdbf072-e07f-410e-9681-8265056a1423): created successfully
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449837ab-fd6c-4e51-9c1a-edb371422f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Flow 'volume_create_manager' (2072f6ec-fff1-40e3-9750-6d7ef8bc6d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:57 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cba195ba-5da8-41f9-a392-9e2f46f383da tempest-VolumeDependencyTests-943665892 None] Created volume successfully.
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2" released by "delete_volume" :: held 1.072s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['d6869248-4645-4910-b0b0-32bb4eab208b', 'd24935ef-ddc3-4b98-97d9-2f6aab74220f', '284c7907-d33a-4f6a-9d44-a5c55161eba1', 'ddbf7e77-4550-46a4-a9bd-6eeb22028d40'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:57 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:57 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (50ae7e5b-b825-4f61-be07-0db7ff6b48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc8c93-3e4b-4696-831c-dee9e76077fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30dc8c93-3e4b-4696-831c-dee9e76077fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821881063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e77753-bbe8-413d-8a69-792350be2367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:57Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cb742b-f5f1-48b9-8d88-e871ceb7f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cb742b-f5f1-48b9-8d88-e871ceb7f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00ccb66-5d2e-422f-bddf-6d9b8c13853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00ccb66-5d2e-422f-bddf-6d9b8c13853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e77753-bbe8-413d-8a69-792350be2367', 'volume_name': 'volume-34e77753-bbe8-413d-8a69-792350be2367', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d081a740-b781-4eeb-99f7-55f5d17eb3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d081a740-b781-4eeb-99f7-55f5d17eb3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2b1ac7-cc26-4414-88f2-927c73a4bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume 34e77753-bbe8-413d-8a69-792350be2367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e77753-bbe8-413d-8a69-792350be2367', 'volume_size': 1}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821881063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e77753-bbe8-413d-8a69-792350be2367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:57Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume 34e77753-bbe8-413d-8a69-792350be2367 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:49:57 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:57 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 1073741824
Sep 29 16:49:57 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:57 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:49:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d549e24e-da70-4b16-91f5-b0ca544d2c7b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-0e2469a8-0c2a-41dc-bf67-6ef55dc5a7f2-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:58 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 1073741824" returned: 0 in 0.527s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:58 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367
Sep 29 16:49:58 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-3d945857-ced4-41da-9863-e6f2149a5209-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-3d945857-ced4-41da-9863-e6f2149a5209-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-3d945857-ced4-41da-9863-e6f2149a5209" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-3d945857-ced4-41da-9863-e6f2149a5209" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[53296b94-22bd-42d8-8020-f3f0ff27e4d5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:58 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367" returned: 0 in 0.345s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.288s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2b1ac7-cc26-4414-88f2-927c73a4bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e77753-bbe8-413d-8a69-792350be2367', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:58 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209
Sep 29 16:49:58 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1e3b94-3e91-4e2d-b71f-3ee594ff833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Creating offline snapshot b6e54e75-e47d-4f57-a118-b2269dc4f148 of volume 1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:49:58 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-34e77753-bbe8-413d-8a69-792350be2367 (34e77753-bbe8-413d-8a69-792350be2367): created successfully
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1e3b94-3e91-4e2d-b71f-3ee594ff833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (50ae7e5b-b825-4f61-be07-0db7ff6b48bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf33fde-4966-43c6-ba99-972781cf773f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8b2a2dfa-5184-4161-bf6d-e6db254bb9f3 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:49:58 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:49:58 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:58 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209" returned: 0 in 0.449s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:58 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209
Sep 29 16:49:58 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:58 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.424s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:59 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 1G
Sep 29 16:49:59 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:59 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-3d945857-ced4-41da-9863-e6f2149a5209" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-3d945857-ced4-41da-9863-e6f2149a5209" released by "delete_volume" :: held 0.822s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['68fd4339-f203-4f43-bfa9-436780b8212d', '994265ac-b60b-4532-b41e-04b062c83ec5', '7d7da758-06fc-42db-bfa2-fc313f00361d', '5e1e7849-557e-4992-bf8c-3b8723f72da5'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:59 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:49:59 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-ea6830ff-c048-4276-a5d5-74917553973a-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-ea6830ff-c048-4276-a5d5-74917553973a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-ea6830ff-c048-4276-a5d5-74917553973a" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-ea6830ff-c048-4276-a5d5-74917553973a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleting offline snapshot ea6830ff-c048-4276-a5d5-74917553973a of volume f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] snapshot_file for this snap is: volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:49:59 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 1G" returned: 0 in 0.593s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdbf072-e07f-410e-9681-8265056a1423 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9985b62f-d5c2-4061-80f3-1cdaa831a16d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:49:59 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.318s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:49:59 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdbf072-e07f-410e-9681-8265056a1423 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:49:59 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:49:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:49:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6928e226-2f57-4082-a431-b2119eff0223 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-3d945857-ced4-41da-9863-e6f2149a5209-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:49:59 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a
Sep 29 16:49:59 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdbf072-e07f-410e-9681-8265056a1423 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.465s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 is being set with open permissions: ugo+rw
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:00 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:50:00 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a" returned: 0 in 0.648s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2716c115-6f9a-4211-b8dc-a42672eb8081]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:00 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:00 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3
Sep 29 16:50:00 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:00 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info
Sep 29 16:50:00 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (2310a61b-3788-4918-a6a4-d88b1da97340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2295e4d-6a14-4261-8232-c16546ce7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2295e4d-6a14-4261-8232-c16546ce7e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235548315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693b6dd-9832-4a59-bed0-d1e2d412fef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:00Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27145891-e04c-489f-8bfa-06d683e5d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27145891-e04c-489f-8bfa-06d683e5d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9492f28d-f048-4383-aab0-296f90a2b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9492f28d-f048-4383-aab0-296f90a2b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c693b6dd-9832-4a59-bed0-d1e2d412fef0', 'volume_name': 'volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5076fa6a-c4b1-4a2e-a98c-fda917634a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5076fa6a-c4b1-4a2e-a98c-fda917634a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f326a014-2149-4427-8002-8d03f41753f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:00 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume c693b6dd-9832-4a59-bed0-d1e2d412fef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0', 'volume_size': 1}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:00 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info is being set with open permissions: ugo+rw
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:00 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info
Sep 29 16:50:00 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3" returned: 0 in 0.572s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:00 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a
Sep 29 16:50:00 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (b24b4fdc-7136-4357-bfb2-cb0d349e7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cddc4c1-1253-4b8f-859d-72f9414e2af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cddc4c1-1253-4b8f-859d-72f9414e2af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990488725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7703312b-04cc-44d9-afcd-1e8de9e7aa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:01Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef30fb9-0c3d-4c8f-b648-e54ae7afec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef30fb9-0c3d-4c8f-b648-e54ae7afec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b567c61b-c27e-4048-a228-f930af55d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b567c61b-c27e-4048-a228-f930af55d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7703312b-04cc-44d9-afcd-1e8de9e7aa95', 'volume_name': 'volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78850143-62f9-4673-8fd6-26e32768efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78850143-62f9-4673-8fd6-26e32768efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895c9e12-064b-449b-851b-1071c9912b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume 7703312b-04cc-44d9-afcd-1e8de9e7aa95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95', 'volume_size': 1}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:01 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.info" returned: 0 in 0.362s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235548315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693b6dd-9832-4a59-bed0-d1e2d412fef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:00Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume c693b6dd-9832-4a59-bed0-d1e2d412fef0 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:01 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-7c6d03a6-bf56-4deb-b3b7-013e7b5c135d tempest-VolumeDependencyTests-943665892 None] Create snapshot completed successfully
Sep 29 16:50:01 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 1073741824
Sep 29 16:50:01 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:01 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a" returned: 0 in 0.595s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:01 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a
Sep 29 16:50:01 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (ff96f0b4-0e3c-4e16-b497-81448f8a39bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a138f87-64d6-4a9a-b0e6-36d4eed11853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a138f87-64d6-4a9a-b0e6-36d4eed11853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782754863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f648c38b-c036-4e8c-8a4c-7720b686a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:01Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb44575-8dec-4508-8181-a717a05e632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb44575-8dec-4508-8181-a717a05e632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583761b3-7da6-4e3c-a6ec-b9f2787a0f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583761b3-7da6-4e3c-a6ec-b9f2787a0f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f648c38b-c036-4e8c-8a4c-7720b686a358', 'volume_name': 'volume-f648c38b-c036-4e8c-8a4c-7720b686a358', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6a2944-ac7a-4f6b-94b2-18872ff70a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6a2944-ac7a-4f6b-94b2-18872ff70a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e587c6-d32b-4eb4-9484-3d6cbcdcc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:01 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume f648c38b-c036-4e8c-8a4c-7720b686a358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f648c38b-c036-4e8c-8a4c-7720b686a358', 'volume_size': 1}
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:01 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3.ea6830ff-c048-4276-a5d5-74917553973a" returned: 0 in 0.417s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:01 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 1073741824" returned: 0 in 0.761s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-ea6830ff-c048-4276-a5d5-74917553973a" released by "_delete_snapshot" :: held 2.487s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" released by "delete_snapshot" :: held 2.536s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:02 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0
Sep 29 16:50:02 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (19c1efb9-9e73-4fcb-a9a7-7a431ebb5b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4066ca-5d4d-4a00-81f2-5bf030032ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4066ca-5d4d-4a00-81f2-5bf030032ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33362654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adb9330-cdb0-4f7c-a2a5-a7a421675bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:02Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371373d7-476c-4d4e-ab47-e2dfef840075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371373d7-476c-4d4e-ab47-e2dfef840075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6252f76-7c70-4b3d-bbbc-9ab6651d1e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6252f76-7c70-4b3d-bbbc-9ab6651d1e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adb9330-cdb0-4f7c-a2a5-a7a421675bf3', 'volume_name': 'volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cfdc67-ea30-49ae-907b-24c669330504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cfdc67-ea30-49ae-907b-24c669330504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddca6381-206f-4bbc-8ae8-5799a048a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume 5adb9330-cdb0-4f7c-a2a5-a7a421675bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3', 'volume_size': 1}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['ded096ac-5d3a-4309-a8a9-7f63e969deb6', '9d609ba4-e476-4987-82e0-cbe530dbd21f', '3b887621-0120-47bf-af8e-8c4707dafc83', '83b3b927-8615-4cf7-ac82-23dbdb90bd19'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Delete snapshot completed successfully.
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac161a24-3d43-409d-8d8f-10550337f693 tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-ea6830ff-c048-4276-a5d5-74917553973a-delete_snapshot" released by "delete_snapshot" :: held 2.996s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:02 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0" returned: 0 in 0.457s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990488725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7703312b-04cc-44d9-afcd-1e8de9e7aa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:01Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume 7703312b-04cc-44d9-afcd-1e8de9e7aa95 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f326a014-2149-4427-8002-8d03f41753f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 1073741824
Sep 29 16:50:02 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886ffdc4-e096-4bcd-a90c-904b68f9db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 (c693b6dd-9832-4a59-bed0-d1e2d412fef0): created successfully
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886ffdc4-e096-4bcd-a90c-904b68f9db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (2310a61b-3788-4918-a6a4-d88b1da97340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-014bdf1f-99b5-4306-8a13-ef5adae9763e tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Flow 'volume_create_manager' (1f99de43-99bf-4863-a542-231f9078d471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f87ec2-45e4-4782-a471-a7b3f4943c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (a8ed9fcc-1205-4195-bea4-e68d08c7fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc1e277-44bb-405b-95f6-df7feada9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f87ec2-45e4-4782-a471-a7b3f4943c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-328616845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629cfdfd-afac-468a-9e0d-ce9910a4a3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0cee3b10574aa59cdbad6e170d6b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6e54e75-e47d-4f57-a118-b2269dc4f148,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:03Z,use_quota=True,user_id='d80323ae386640848947c4f55da0d0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e862f07e-9be2-4cc3-a484-14467b44d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e862f07e-9be2-4cc3-a484-14467b44d857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d624ac9-af63-4866-9451-418b20260068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d624ac9-af63-4866-9451-418b20260068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '629cfdfd-afac-468a-9e0d-ce9910a4a3fe', 'volume_name': 'volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe', 'volume_size': 1, 'snapshot_id': 'b6e54e75-e47d-4f57-a118-b2269dc4f148'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c124e7-bd0d-4548-a388-fc46c03f380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c124e7-bd0d-4548-a388-fc46c03f380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6504cbb-1268-4240-9ac9-857dbe9c1464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Volume 629cfdfd-afac-468a-9e0d-ce9910a4a3fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe', 'volume_size': 1, 'snapshot_id': 'b6e54e75-e47d-4f57-a118-b2269dc4f148'}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc1e277-44bb-405b-95f6-df7feada9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744638725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b25786-5d02-44ef-8184-5c7d9a38259f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:03Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8d160c-7938-4e0d-a15b-72c26ae0685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8d160c-7938-4e0d-a15b-72c26ae0685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c291ba47-0ee4-423a-962b-e7c08773abe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c291ba47-0ee4-423a-962b-e7c08773abe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b25786-5d02-44ef-8184-5c7d9a38259f', 'volume_name': 'volume-35b25786-5d02-44ef-8184-5c7d9a38259f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbec23b-c6a1-476c-8dcd-b2a796b635d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbec23b-c6a1-476c-8dcd-b2a796b635d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa92491c-cbf5-472c-bae7-0a9d307de7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume 35b25786-5d02-44ef-8184-5c7d9a38259f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b25786-5d02-44ef-8184-5c7d9a38259f', 'volume_size': 1}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-f3351f70-43d4-4334-8c18-e98b0c30e9a3-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-f3351f70-43d4-4334-8c18-e98b0c30e9a3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4193ce-c599-4948-bd60-d33268489a6d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:03 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 1073741824" returned: 0 in 0.641s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:03 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3
Sep 29 16:50:03 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:03 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95
Sep 29 16:50:03 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:03 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782754863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f648c38b-c036-4e8c-8a4c-7720b686a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:01Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume f648c38b-c036-4e8c-8a4c-7720b686a358 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:03 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:03 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3" returned: 0 in 0.483s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:03 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 1073741824
Sep 29 16:50:03 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895c9e12-064b-449b-851b-1071c9912b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82645d17-2f3f-4ead-88f6-ed4d4dd88b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:03 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3
Sep 29 16:50:03 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 (7703312b-04cc-44d9-afcd-1e8de9e7aa95): created successfully
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82645d17-2f3f-4ead-88f6-ed4d4dd88b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (b24b4fdc-7136-4357-bfb2-cb0d349e7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-5c3816e7-4f65-4ca8-8299-5223d98c97dc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:50:03 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f3351f70-43d4-4334-8c18-e98b0c30e9a3" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:03 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-quobyte-f3351f70-43d4-4334-8c18-e98b0c30e9a3" released by "delete_volume" :: held 0.837s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Created reservations ['2d9a39fa-8898-4f19-a2f8-d8b9035cc1bc', '68f3807b-65fd-40df-a079-84e233c52ebf', '351f64c1-7549-4472-8fb9-a83ec5e0633c', '298391ba-77e4-414b-85c0-6fe64fc111b5'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:04 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:04 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:04 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 1073741824" returned: 0 in 0.501s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:04 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358
Sep 29 16:50:04 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:04 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Deleted volume successfully.
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-45581cbb-efe2-439e-a3ae-72508ede0e1b tempest-CreateVolumesFromSnapshotTest-261690805 None] Lock "cinder-f3351f70-43d4-4334-8c18-e98b0c30e9a3-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:04 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.275s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33362654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adb9330-cdb0-4f7c-a2a5-a7a421675bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:02Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume 5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:04 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e587c6-d32b-4eb4-9484-3d6cbcdcc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f648c38b-c036-4e8c-8a4c-7720b686a358', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:04 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 1073741824
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06e197-6d20-4a0b-bc3d-44faf7e53fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:04 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:04 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-f648c38b-c036-4e8c-8a4c-7720b686a358 (f648c38b-c036-4e8c-8a4c-7720b686a358): created successfully
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de06e197-6d20-4a0b-bc3d-44faf7e53fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:04 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (ff96f0b4-0e3c-4e16-b497-81448f8a39bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-78af6498-fd2c-4a69-9995-378f483fc53a tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:50:05 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 1073741824" returned: 0 in 0.675s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:05 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3
Sep 29 16:50:05 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:05 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.520s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744638725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b25786-5d02-44ef-8184-5c7d9a38259f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e339626830470fa1c09432e4853e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:03Z,use_quota=True,user_id='c634eabee571494d9321a82ed88409a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Creating volume 35b25786-5d02-44ef-8184-5c7d9a38259f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:05 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddca6381-206f-4bbc-8ae8-5799a048a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b514d4-ac3b-4b5d-8201-45b8eb55744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:05 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f 1073741824
Sep 29 16:50:05 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:05 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 (5adb9330-cdb0-4f7c-a2a5-a7a421675bf3): created successfully
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b514d4-ac3b-4b5d-8201-45b8eb55744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (19c1efb9-9e73-4fcb-a9a7-7a431ebb5b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-50ecefef-0b85-4a5c-860c-fc9117b606e5 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:50:06 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f 1073741824" returned: 0 in 0.652s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:06 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f
Sep 29 16:50:06 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:06 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.490s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa92491c-cbf5-472c-bae7-0a9d307de7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b25786-5d02-44ef-8184-5c7d9a38259f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598eb01-581d-4f63-b2e4-50d94fbad1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Creating volume 629cfdfd-afac-468a-9e0d-ce9910a4a3fe from snapshot b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Volume volume-35b25786-5d02-44ef-8184-5c7d9a38259f (35b25786-5d02-44ef-8184-5c7d9a38259f): created successfully
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598eb01-581d-4f63-b2e4-50d94fbad1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Flow 'volume_create_manager' (a8ed9fcc-1205-4195-bea4-e68d08c7fb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] snapshot: b6e54e75-e47d-4f57-a118-b2269dc4f148, volume: 629cfdfd-afac-468a-9e0d-ce9910a4a3fe,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:50:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4925b534-347e-467b-81e4-686c217d2f3c tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created volume successfully.
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[738eab59-6b65-448f-b6ad-bc5395e89f0e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:06 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:50:06 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:07 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.494s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdbf072-e07f-410e-9681-8265056a1423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc9f67c-fdbd-4f1e-846b-f0bda4680ca9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-35b25786-5d02-44ef-8184-5c7d9a38259f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-35b25786-5d02-44ef-8184-5c7d9a38259f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-35b25786-5d02-44ef-8184-5c7d9a38259f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-35b25786-5d02-44ef-8184-5c7d9a38259f" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:07 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:50:07 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd2317c-4974-4ab4-b9ad-5af410e1e5bb]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:07 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f
Sep 29 16:50:07 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:07 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.691s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:50:07 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:08 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe
Sep 29 16:50:08 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:08 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f" returned: 0 in 0.642s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:08 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f
Sep 29 16:50:08 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:08 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-35b25786-5d02-44ef-8184-5c7d9a38259f" returned: 0 in 0.360s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-35b25786-5d02-44ef-8184-5c7d9a38259f" released by "delete_volume" :: held 1.122s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['c0361d86-0e33-40db-bcb6-09ccc48b74b1', 'd7f92d3f-0e6f-46af-9ea0-2b59ebcf8013', '7a0fa587-1cab-4d79-8c76-ee6976d4a378', 'b027fc65-a08e-4601-a32a-824eb90dcc33'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:08 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:08 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:09 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.693s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a66742c3-7f2f-4a4b-95d0-6a91ab9cdf03 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-35b25786-5d02-44ef-8184-5c7d9a38259f-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" acquired by "delete_volume" :: waited 0.049s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:10 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abeebb2-78be-4a7a-800e-e504eaad3ee9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:10 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3
Sep 29 16:50:10 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:11 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" returned: 0 in 0.880s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:11 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3
Sep 29 16:50:11 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:11 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" returned: 0 in 0.606s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3" released by "delete_volume" :: held 1.644s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:11 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['79bd5885-d28c-4c74-aca7-8292c6b304e1', '70c6596e-7cf5-4b1b-bdd7-f02b0e726e0f', '00784f92-1f8d-41c6-836a-563741553c0b', '1ecf3d8a-3de5-450f-a63d-7e3aab9017ba'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:12 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:12 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-f648c38b-c036-4e8c-8a4c-7720b686a358-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-f648c38b-c036-4e8c-8a4c-7720b686a358-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-f648c38b-c036-4e8c-8a4c-7720b686a358" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-f648c38b-c036-4e8c-8a4c-7720b686a358" acquired by "delete_volume" :: waited 0.051s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:12 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.680s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058d7ac-949f-42b2-8ef5-51136c9ccf87]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9ac1bbe1-4a40-4f66-bf75-ad1d41ec1086 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-5adb9330-cdb0-4f7c-a2a5-a7a421675bf3-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:12 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358
Sep 29 16:50:12 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:13 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358" returned: 0 in 0.826s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:13 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358
Sep 29 16:50:13 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:14 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-f648c38b-c036-4e8c-8a4c-7720b686a358" returned: 0 in 0.451s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-f648c38b-c036-4e8c-8a4c-7720b686a358" released by "delete_volume" :: held 1.412s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['56dec084-46dd-48cd-945b-148f0ba81479', '252f8435-e31d-4742-bc50-29274d290b5d', '06c0ecd5-d933-4ac7-a2eb-1b193b877880', 'c858bf85-7804-4324-bcee-5ec0d06b8ea0'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:14 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:14 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:14 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.510s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-35526017-a2b4-4691-9b7f-7d5df607f4f2 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-f648c38b-c036-4e8c-8a4c-7720b686a358-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-7703312b-04cc-44d9-afcd-1e8de9e7aa95-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-7703312b-04cc-44d9-afcd-1e8de9e7aa95-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-7703312b-04cc-44d9-afcd-1e8de9e7aa95" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-7703312b-04cc-44d9-afcd-1e8de9e7aa95" acquired by "delete_volume" :: waited 0.031s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda72002-e137-4e0f-aaf2-2daf8f6b0584]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:15 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95
Sep 29 16:50:15 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Flow 'volume_create_manager' (f7bad63f-a049-44a0-8679-130bbfb6b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5628a2-2fac-4c99-a611-efeac779451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5628a2-2fac-4c99-a611-efeac779451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e364cebe-6917-48b4-90cc-5d1642c99b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d203761ee140fbbbd6c89dcecf1bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:16Z,use_quota=True,user_id='b55bd2ca8075412284642276510c3a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca606047-d164-49d6-bcbf-7e8aad37c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca606047-d164-49d6-bcbf-7e8aad37c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc6fe70-fb52-4a0d-87af-e35e68fdb27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:15 devstack cinder-volume[86843]: DEBUG cinder.image.glance [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Creating Keystone auth plugin from conf {{(pid=86843) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 16:50:16 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95" returned: 0 in 0.769s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:16 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95
Sep 29 16:50:16 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:16 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7703312b-04cc-44d9-afcd-1e8de9e7aa95" returned: 0 in 0.531s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-7703312b-04cc-44d9-afcd-1e8de9e7aa95" released by "delete_volume" :: held 1.429s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc6fe70-fb52-4a0d-87af-e35e68fdb27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e364cebe-6917-48b4-90cc-5d1642c99b62', 'volume_name': 'volume-e364cebe-6917-48b4-90cc-5d1642c99b62', 'volume_size': 1, 'image_id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f52aac24c9e4c42b719c0cf376cda1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d203761ee140fbbbd6c89dcecf1bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8771e5a6bd94f79059b7eb919bc89b9483831042e23fac2c3c9fd4c5230450090a7b15bb26cd2c46358875fb2e4d5d25137d3811b209f4216ce3410627831a38', 'id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 50, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd221796-619a-4b6e-9264-d0fd30e17336/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9aa390>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc754a2e-ecb6-4085-b828-24fdc8191e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc754a2e-ecb6-4085-b828-24fdc8191e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e5fcd-9d9c-4ecd-8e1f-2d3397d5b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Volume e364cebe-6917-48b4-90cc-5d1642c99b62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e364cebe-6917-48b4-90cc-5d1642c99b62', 'volume_size': 1, 'image_id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f52aac24c9e4c42b719c0cf376cda1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d203761ee140fbbbd6c89dcecf1bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8771e5a6bd94f79059b7eb919bc89b9483831042e23fac2c3c9fd4c5230450090a7b15bb26cd2c46358875fb2e4d5d25137d3811b209f4216ce3410627831a38', 'id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 50, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd221796-619a-4b6e-9264-d0fd30e17336/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9aa390>}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Trying to clone e364cebe-6917-48b4-90cc-5d1642c99b62 from image bd221796-619a-4b6e-9264-d0fd30e17336 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}]). {{(pid=86843) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['f4eff961-1b5e-41b7-80df-7c2fc5fbb423', '49fd21e0-d944-4715-bba4-00d49acf7cd3', 'baf037f6-7a18-44f6-9574-d66fcb3c026d', '157f1396-43cb-4c22-b80e-2fc3785f67ef'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:16 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 16:50:16 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:17 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:17 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b2d03-90c9-467c-ad7c-2c5f4a722dd6]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:17 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:17 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-c693b6dd-9832-4a59-bed0-d1e2d412fef0-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:17 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.595s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-c693b6dd-9832-4a59-bed0-d1e2d412fef0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-076e70d8-19bc-4747-b984-b6ced1cb0b59 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-7703312b-04cc-44d9-afcd-1e8de9e7aa95-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-c693b6dd-9832-4a59-bed0-d1e2d412fef0" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-c693b6dd-9832-4a59-bed0-d1e2d412fef0" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[800580ff-cbef-4bd0-8cf0-0e51dc5d4189]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:17 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:18 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0
Sep 29 16:50:18 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:18 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:18 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:18 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" returned: 0 in 10.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423, size 1024.00 MB, duration 10.29 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:50:18 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Converted 1024.00 MB image at 99.53 MB/s
Sep 29 16:50:18 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe is being set with open permissions: ugo+rw
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:18 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe
Sep 29 16:50:18 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:18 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Temporary image bd221796-619a-4b6e-9264-d0fd30e17336 is fetched for user b55bd2ca8075412284642276510c3a7b. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 16:50:18 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0" returned: 0 in 0.644s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:18 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0
Sep 29 16:50:18 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1765b8ab-f466-42c7-a2f3-70d5c1a7b6a5]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:18 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" released by "_copy_volume_from_snapshot" :: held 11.937s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" released by "_create_volume_from_snapshot" :: held 12.056s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.108s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:18 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:18 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6504cbb-1268-4240-9ac9-857dbe9c1464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe', 'volume_size': 1, 'snapshot_id': 'b6e54e75-e47d-4f57-a118-b2269dc4f148'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a9de6-2b8f-4c96-815d-4689b2b736da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:18 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Volume volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe (629cfdfd-afac-468a-9e0d-ce9910a4a3fe): created successfully
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a9de6-2b8f-4c96-815d-4689b2b736da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Flow 'volume_create_manager' (1f99de43-99bf-4863-a542-231f9078d471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-18adddcc-7a47-4ac4-bf04-cf8c6135a42a tempest-VolumeDependencyTests-943665892 None] Created volume successfully.
Sep 29 16:50:18 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c693b6dd-9832-4a59-bed0-d1e2d412fef0" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-c693b6dd-9832-4a59-bed0-d1e2d412fef0" released by "delete_volume" :: held 1.040s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['0d71132b-6eff-40c2-8271-a0c1460815d7', '763a6e04-3079-44e9-84f4-1882da569317', 'a604f80c-de1d-4224-8437-103dab457bc2', '90c6b09a-b5c6-4c98-a7f4-1b3ce3ced902'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:18 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:19 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:19 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:19 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:19 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:19 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e364cebe-6917-48b4-90cc-5d1642c99b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d203761ee140fbbbd6c89dcecf1bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:16Z,use_quota=True,user_id='b55bd2ca8075412284642276510c3a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Creating volume e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:19 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:19 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.335s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:19 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:19 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1073741824
Sep 29 16:50:19 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-df930b9e-cfc1-47db-b1a5-3d99ab0c3bb4 tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-c693b6dd-9832-4a59-bed0-d1e2d412fef0-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-b6e54e75-e47d-4f57-a118-b2269dc4f148-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-b6e54e75-e47d-4f57-a118-b2269dc4f148-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Deleting offline snapshot b6e54e75-e47d-4f57-a118-b2269dc4f148 of volume 1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] snapshot_file for this snap is: volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf21f91c-a325-4b00-9824-02d1b197caf4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:19 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:50:19 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:19 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1073741824" returned: 0 in 0.497s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:19 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62
Sep 29 16:50:19 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:19 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdbf072-e07f-410e-9681-8265056a1423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0365a0-409d-4465-92ee-5a071208c5b7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-34e77753-bbe8-413d-8a69-792350be2367-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-34e77753-bbe8-413d-8a69-792350be2367-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "cinder-quobyte-34e77753-bbe8-413d-8a69-792350be2367" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-34e77753-bbe8-413d-8a69-792350be2367" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2b22b-45fc-4d43-b68a-9be2cec261f5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:20 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:50:20 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62" returned: 0 in 0.344s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Attempting download of bd221796-619a-4b6e-9264-d0fd30e17336 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}])) to volume e364cebe-6917-48b4-90cc-5d1642c99b62. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0999a5-5df9-445e-bc3a-578a71894c57]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367
Sep 29 16:50:20 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh
Sep 29 16:50:20 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367" returned: 0 in 0.476s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.681s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:20 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:20 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:50:20 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh" returned: 0 in 0.436s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:20 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh
Sep 29 16:50:20 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:20 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-34e77753-bbe8-413d-8a69-792350be2367" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-quobyte-34e77753-bbe8-413d-8a69-792350be2367" released by "delete_volume" :: held 0.820s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Created reservations ['84a63bea-51e5-4364-84fc-1938404ef428', '35f8970a-3af7-4f2f-a798-c23ae47995b9', '3a9f056b-4e89-4657-827f-8f1f0455a16f', '822c7222-6577-414a-9064-5104ab8f1c8c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:21 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh" returned: 1 in 0.383s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd221796-619a-4b6e-9264-d0fd30e17336_i8qg4jvh' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:50:21 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae4e36-e983-4900-88ed-c82f0f52173b]: (4, 'raw') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.446s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:21 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:21 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:21 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:21 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:21 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423.b6e54e75-e47d-4f57-a118-b2269dc4f148" returned: 0 in 0.429s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:21 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:21 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.466s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-b6e54e75-e47d-4f57-a118-b2269dc4f148" released by "_delete_snapshot" :: held 2.179s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Deleted volume successfully.
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" released by "delete_snapshot" :: held 2.218s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-48e0d112-6131-445e-973e-616716e30dbc tempest-CreateVolumesFromSourceVolumeTest-1155943557 None] Lock "cinder-34e77753-bbe8-413d-8a69-792350be2367-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Created reservations ['0a631fcb-12ec-4d42-9f25-5434abc13f81', 'ac74238b-ac14-4eec-a79d-06e344c05064', '341bcfbb-4332-40c4-8d9d-dcdecf478582', '0f3e2166-7ce3-4b33-be3c-248fadc92614'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:21 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD
Sep 29 16:50:21 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:21 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Delete snapshot completed successfully.
Sep 29 16:50:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-23eea696-cbc8-42a2-84d7-aa0bbced1fcd tempest-VolumeDependencyTests-943665892 None] Lock "cinder-b6e54e75-e47d-4f57-a118-b2269dc4f148-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:22 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD" returned: 1 in 0.487s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] bd221796-619a-4b6e-9264-d0fd30e17336 was raw, converting to qcow2 {{(pid=86843) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:22 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62
Sep 29 16:50:22 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:22 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-1fdbf072-e07f-410e-9681-8265056a1423-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62" returned: 0 in 0.606s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd221796-619a-4b6e-9264-d0fd30e17336_uff7v5wddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:50:22 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "cinder-1fdbf072-e07f-410e-9681-8265056a1423-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:22 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1G
Sep 29 16:50:22 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" acquired by "delete_volume" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536458c-89cd-4a0c-a349-81fd5ce4ff96]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:23 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:50:23 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:23 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 1G" returned: 0 in 0.493s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Downloaded image bd221796-619a-4b6e-9264-d0fd30e17336 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}])) to volume e364cebe-6917-48b4-90cc-5d1642c99b62 successfully. {{(pid=86843) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Temporary image bd221796-619a-4b6e-9264-d0fd30e17336 for user b55bd2ca8075412284642276510c3a7b is deleted. {{(pid=86843) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.volume_utils [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Marking volume e364cebe-6917-48b4-90cc-5d1642c99b62 as bootable. {{(pid=86843) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Copying metadata from image bd221796-619a-4b6e-9264-d0fd30e17336 to e364cebe-6917-48b4-90cc-5d1642c99b62. {{(pid=86843) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Creating volume glance metadata for volume e364cebe-6917-48b4-90cc-5d1642c99b62 backed by image bd221796-619a-4b6e-9264-d0fd30e17336 with: {'image_id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '84f52aac24c9e4c42b719c0cf376cda1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86843) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e5fcd-9d9c-4ecd-8e1f-2d3397d5b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e364cebe-6917-48b4-90cc-5d1642c99b62', 'volume_size': 1, 'image_id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd221796-619a-4b6e-9264-d0fd30e17336', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f52aac24c9e4c42b719c0cf376cda1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6d203761ee140fbbbd6c89dcecf1bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8771e5a6bd94f79059b7eb919bc89b9483831042e23fac2c3c9fd4c5230450090a7b15bb26cd2c46358875fb2e4d5d25137d3811b209f4216ce3410627831a38', 'id': 'bd221796-619a-4b6e-9264-d0fd30e17336', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 50, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd221796-619a-4b6e-9264-d0fd30e17336/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7560ed9aa390>}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d02e2e-8904-4d49-9f44-74f8b2f07758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:23 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Volume volume-e364cebe-6917-48b4-90cc-5d1642c99b62 (e364cebe-6917-48b4-90cc-5d1642c99b62): created successfully
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d02e2e-8904-4d49-9f44-74f8b2f07758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Flow 'volume_create_manager' (f7bad63f-a049-44a0-8679-130bbfb6b911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-861d0dcf-97c9-4cf3-ae8a-a597ff176701 tempest-VolumeImageDependencyTests-1696966765 None] Created volume successfully.
Sep 29 16:50:23 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.523s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:23 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423
Sep 29 16:50:23 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:23 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-1fdbf072-e07f-410e-9681-8265056a1423" returned: 0 in 0.349s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-1fdbf072-e07f-410e-9681-8265056a1423" released by "delete_volume" :: held 0.974s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:23 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Created reservations ['51342166-edc9-4109-a9bb-dcb6d7a012a5', '311a8846-1ff3-4663-b553-15a6fb2165e2', '5a061efb-67cd-49ce-a0b0-1f24a675d233', 'b8136628-8196-45e6-b4ba-a1061f5f10c3'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:24 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:24 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:24 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.321s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:24 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Deleted volume successfully.
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed675306-df7d-420d-896d-dc97bdb80e1b tempest-VolumeDependencyTests-943665892 None] Lock "cinder-1fdbf072-e07f-410e-9681-8265056a1423-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Acquiring lock "cinder-e364cebe-6917-48b4-90cc-5d1642c99b62-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "cinder-e364cebe-6917-48b4-90cc-5d1642c99b62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Acquiring lock "cinder-quobyte-e364cebe-6917-48b4-90cc-5d1642c99b62" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "cinder-quobyte-e364cebe-6917-48b4-90cc-5d1642c99b62" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec9b39-57b0-4c26-a23c-5a6420a49df4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:24 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62
Sep 29 16:50:24 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-629cfdfd-afac-468a-9e0d-ce9910a4a3fe-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-629cfdfd-afac-468a-9e0d-ce9910a4a3fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:25 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62" returned: 0 in 0.527s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:25 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:25 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b981f435-3f2a-4608-abff-db61088eb478]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:25 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe
Sep 29 16:50:25 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:25 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e364cebe-6917-48b4-90cc-5d1642c99b62" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "cinder-quobyte-e364cebe-6917-48b4-90cc-5d1642c99b62" released by "delete_volume" :: held 0.922s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Created reservations ['e301d9b8-deef-4f08-a12d-eabd54eac182', '8ae657af-8f9a-4698-a670-01705b454ebf', 'c5e2cb5c-c8d0-4ee4-a4ec-00e80048d330', 'e87e144a-59f5-4c10-ae24-5df6e05fcb44'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:25 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:25 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:25 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" returned: 0 in 0.557s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:25 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe
Sep 29 16:50:25 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:26 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.379s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Deleted volume successfully.
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-6d285502-61c1-4715-a1f4-405144d8c19f tempest-VolumeImageDependencyTests-1696966765 None] Lock "cinder-e364cebe-6917-48b4-90cc-5d1642c99b62-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:26 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" returned: 0 in 0.334s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-quobyte-629cfdfd-afac-468a-9e0d-ce9910a4a3fe" released by "delete_volume" :: held 0.976s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Created reservations ['7bfc1b5c-bc75-4ad3-89f0-31c5690d895f', 'f99a3c32-9de7-450b-b82d-1378ba411acb', '86840b75-8ea0-4411-9a07-37b6c13584f3', 'c260b5f2-735b-4089-a109-ed3582c89b06'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:26 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:26 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:26 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.331s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Deleted volume successfully.
Sep 29 16:50:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c68bbe94-88a0-43a3-91fe-116dfb61fc7a tempest-VolumeDependencyTests-943665892 None] Lock "cinder-629cfdfd-afac-468a-9e0d-ce9910a4a3fe-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Flow 'volume_create_manager' (a7f1555f-84b2-4c39-a570-41351b85c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2176bd78-154e-47d2-a775-22c64e2f78bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2176bd78-154e-47d2-a775-22c64e2f78bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1261286618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a64c9b5-ac13-4494-8a6a-c92572a596a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61572bb5b9b4ce3b2a986e3cdec43e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:28Z,use_quota=True,user_id='42914bf5a0fe433a860f88961caa258c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5845067-9920-4284-89c7-1ad8cdbdc5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5845067-9920-4284-89c7-1ad8cdbdc5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de93d032-b254-4a0c-a349-88611f649ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de93d032-b254-4a0c-a349-88611f649ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a64c9b5-ac13-4494-8a6a-c92572a596a0', 'volume_name': 'volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfb7701-4a27-4ade-8280-1c7e2fcbb736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfb7701-4a27-4ade-8280-1c7e2fcbb736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261fe346-e11a-463d-b41d-f6d67b9ea667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:28 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Volume 6a64c9b5-ac13-4494-8a6a-c92572a596a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0', 'volume_size': 1}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1261286618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a64c9b5-ac13-4494-8a6a-c92572a596a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61572bb5b9b4ce3b2a986e3cdec43e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:28Z,use_quota=True,user_id='42914bf5a0fe433a860f88961caa258c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Creating volume 6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:28 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:28 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 1073741824
Sep 29 16:50:28 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:28 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 1073741824" returned: 0 in 0.510s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:28 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:28 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:29 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.356s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261fe346-e11a-463d-b41d-f6d67b9ea667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a948125-c5eb-4bee-987b-fb2a8d8826cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:29 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Volume volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 (6a64c9b5-ac13-4494-8a6a-c92572a596a0): created successfully
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a948125-c5eb-4bee-987b-fb2a8d8826cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:29 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Flow 'volume_create_manager' (a7f1555f-84b2-4c39-a570-41351b85c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac85949b-3716-46a0-a99e-77dc503b5286 tempest-SnapshotDependencyTests-666180542 None] Created volume successfully.
Sep 29 16:50:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Creating offline snapshot 30c8c7fa-a0b4-438e-9830-d372c0f51a90 of volume 6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:30 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[248cfd5e-feab-477d-8ed9-5dd15441bbf5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:30 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:30 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=181,cinder:UPDATE=252,cinder:INSERT=73,cinder:DELETE=21 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=252,cinder:SELECT=182,cinder:DELETE=24,cinder:INSERT=62 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:31 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Flow 'volume_create_manager' (9a0640a3-9023-4681-81a7-8e8d1a16b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f949bed7-1eb1-4e89-a460-a9efcd89430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.594s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f949bed7-1eb1-4e89-a460-a9efcd89430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e74f33-397f-43a2-abc9-82a39159afdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056b74a5f2404d8fb7bdf0ac9d0214f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:31Z,use_quota=True,user_id='108c153ee518469c9408afdc26f10324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:31 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 1G
Sep 29 16:50:31 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d685b9-d074-472a-a4cb-eefd52631bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d685b9-d074-472a-a4cb-eefd52631bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d75b748-aee3-4a5a-8f80-5ce77290462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d75b748-aee3-4a5a-8f80-5ce77290462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e74f33-397f-43a2-abc9-82a39159afdf', 'volume_name': 'volume-05e74f33-397f-43a2-abc9-82a39159afdf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f45e1-a366-4066-9c7c-063c3f405917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f45e1-a366-4066-9c7c-063c3f405917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0d6511-b3a9-4b34-9bcb-4e4db9a1f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Volume 05e74f33-397f-43a2-abc9-82a39159afdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e74f33-397f-43a2-abc9-82a39159afdf', 'volume_size': 1}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:31 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 1G" returned: 0 in 0.526s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:31 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:31 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:32 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.346s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:32 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 is being set with open permissions: ugo+rw
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:32 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:32 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:32 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:32 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info
Sep 29 16:50:32 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:32 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:32 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info is being set with open permissions: ugo+rw
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:32 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info
Sep 29 16:50:32 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:32 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.info" returned: 0 in 0.272s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e74f33-397f-43a2-abc9-82a39159afdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056b74a5f2404d8fb7bdf0ac9d0214f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:31Z,use_quota=True,user_id='108c153ee518469c9408afdc26f10324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Creating volume 05e74f33-397f-43a2-abc9-82a39159afdf {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:32 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:32 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf 1073741824
Sep 29 16:50:33 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4a4a3e99-37b0-49f3-8820-8a4911c43d66 tempest-SnapshotDependencyTests-666180542 None] Create snapshot completed successfully
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (aa49fa99-3354-4d60-8754-846ea1d110f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489576dc-f3b0-427c-9e23-1419f560dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489576dc-f3b0-427c-9e23-1419f560dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391988837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a156baa-f914-4152-84c2-a765a2520125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:33Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f616256d-a699-4d17-a017-690945130baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f616256d-a699-4d17-a017-690945130baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c792704a-c204-432f-9ef8-dbff4782d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c792704a-c204-432f-9ef8-dbff4782d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a156baa-f914-4152-84c2-a765a2520125', 'volume_name': 'volume-7a156baa-f914-4152-84c2-a765a2520125', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c6532-d2a3-40c2-b518-ef8f3b6e60a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2c6532-d2a3-40c2-b518-ef8f3b6e60a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d02158-44d7-4be4-8802-280926275879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Volume 7a156baa-f914-4152-84c2-a765a2520125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a156baa-f914-4152-84c2-a765a2520125', 'volume_size': 1}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf 1073741824" returned: 0 in 0.580s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:33 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf
Sep 29 16:50:33 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:33 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf" returned: 0 in 0.255s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391988837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a156baa-f914-4152-84c2-a765a2520125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:33Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Creating volume 7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:33 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0d6511-b3a9-4b34-9bcb-4e4db9a1f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e74f33-397f-43a2-abc9-82a39159afdf', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7611408d-1fb4-4a43-bd43-378c87f9fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:33 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 1073741824
Sep 29 16:50:33 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:33 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Volume volume-05e74f33-397f-43a2-abc9-82a39159afdf (05e74f33-397f-43a2-abc9-82a39159afdf): created successfully
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7611408d-1fb4-4a43-bd43-378c87f9fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:33 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Flow 'volume_create_manager' (9a0640a3-9023-4681-81a7-8e8d1a16b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bcf597f1-8888-430f-a492-d15b1ffa2b6f tempest-CinderUnicodeTest-666647752 None] Created volume successfully.
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Flow 'volume_create_manager' (59380a91-7e7f-45b6-b95d-1d398391aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c989247e-2262-4b1e-ba7c-9406510dbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c989247e-2262-4b1e-ba7c-9406510dbe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e350326-c9ad-447b-a25d-e26c47b11088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61572bb5b9b4ce3b2a986e3cdec43e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30c8c7fa-a0b4-438e-9830-d372c0f51a90,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:34Z,use_quota=True,user_id='42914bf5a0fe433a860f88961caa258c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75047ea-efd1-45a8-98da-ea8ba21d408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75047ea-efd1-45a8-98da-ea8ba21d408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1963a4f0-182e-4d04-8e6f-be9fb11f4d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1963a4f0-182e-4d04-8e6f-be9fb11f4d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e350326-c9ad-447b-a25d-e26c47b11088', 'volume_name': 'volume-2e350326-c9ad-447b-a25d-e26c47b11088', 'volume_size': 1, 'snapshot_id': '30c8c7fa-a0b4-438e-9830-d372c0f51a90'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de713d0-1ba0-4dd6-8e1b-cdf1b63859bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de713d0-1ba0-4dd6-8e1b-cdf1b63859bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032fe2c6-944b-492a-a1f9-968566820145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Volume 2e350326-c9ad-447b-a25d-e26c47b11088: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e350326-c9ad-447b-a25d-e26c47b11088', 'volume_size': 1, 'snapshot_id': '30c8c7fa-a0b4-438e-9830-d372c0f51a90'}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 1073741824" returned: 0 in 0.648s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:34 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125
Sep 29 16:50:34 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:34 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.392s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90-2e350326-c9ad-447b-a25d-e26c47b11088" by "_create_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d02158-44d7-4be4-8802-280926275879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a156baa-f914-4152-84c2-a765a2520125', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249a5722-768b-4f62-a1a9-21018ac55e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90-2e350326-c9ad-447b-a25d-e26c47b11088" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Creating volume 2e350326-c9ad-447b-a25d-e26c47b11088 from snapshot 30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" by "_copy_volume_from_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:34 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Volume volume-7a156baa-f914-4152-84c2-a765a2520125 (7a156baa-f914-4152-84c2-a765a2520125): created successfully
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249a5722-768b-4f62-a1a9-21018ac55e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (aa49fa99-3354-4d60-8754-846ea1d110f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] snapshot: 30c8c7fa-a0b4-438e-9830-d372c0f51a90, volume: 2e350326-c9ad-447b-a25d-e26c47b11088,  {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 16:50:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a0761ab0-c4a3-4238-9a0f-2ed0d8d08537 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Flow 'volume_create_manager' (9dcafe0a-824f-470e-be30-8a4db4980f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3656da-ddef-4ef6-92e8-abd224b362e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba70451-a1e2-4c65-b662-789ffc521bb2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3656da-ddef-4ef6-92e8-abd224b362e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978752535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987579f0-2859-47b6-8ae8-87d38c9a3271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056b74a5f2404d8fb7bdf0ac9d0214f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:35Z,use_quota=True,user_id='108c153ee518469c9408afdc26f10324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8920d2b2-9680-4987-b358-2fcc7a70ba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8920d2b2-9680-4987-b358-2fcc7a70ba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d5b8b0-9e67-4870-b7a5-dd35ba35d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d5b8b0-9e67-4870-b7a5-dd35ba35d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987579f0-2859-47b6-8ae8-87d38c9a3271', 'volume_name': 'volume-987579f0-2859-47b6-8ae8-87d38c9a3271', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26851492-594a-408d-8464-6e6c10a09e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26851492-594a-408d-8464-6e6c10a09e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019fa1a5-520f-427b-8781-7b6e67bbc70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:35 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Volume 987579f0-2859-47b6-8ae8-87d38c9a3271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987579f0-2859-47b6-8ae8-87d38c9a3271', 'volume_size': 1}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:35 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:35 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:35 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.431s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb4e1c2-c1e8-4dbe-af28-b923d4263a9d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:35 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:35 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:35 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.435s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 16:50:35 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Creating direct copy from snapshot {{(pid=86843) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 16:50:36 devstack cinder-volume[86843]: DEBUG cinder.utils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Path /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 not found in is_blk_device check {{(pid=86843) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 16:50:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:36 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088
Sep 29 16:50:36 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (30f0cb5c-0fe2-4934-9622-b55595d5c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc97111-8ba6-4773-ac5c-a48e2de3228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc97111-8ba6-4773-ac5c-a48e2de3228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103050462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c065d9c1-3938-428d-96a4-a73b8cb2dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:39Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8f41b-a2aa-4ab9-a572-6bd61cedcd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8f41b-a2aa-4ab9-a572-6bd61cedcd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d9d5d8-fea6-4fb4-b308-4e5b8c37ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d9d5d8-fea6-4fb4-b308-4e5b8c37ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c065d9c1-3938-428d-96a4-a73b8cb2dfe9', 'volume_name': 'volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981fd63b-1f39-425e-bbd7-cbf23727f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981fd63b-1f39-425e-bbd7-cbf23727f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9936e7-7ecd-426a-9098-cb14e4b4d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Volume c065d9c1-3938-428d-96a4-a73b8cb2dfe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9', 'volume_size': 1}
Sep 29 16:50:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:42 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088" returned: 0 in 6.583s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.image.image_utils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Image conversion details: src /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 {{(pid=86843) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 16:50:42 devstack cinder-volume[86843]: INFO cinder.image.image_utils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Converted 1024.00 MB image at 155.52 MB/s
Sep 29 16:50:42 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 is being set with open permissions: ugo+rw
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:42 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088
Sep 29 16:50:42 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:42 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088" returned: 0 in 0.246s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" released by "_copy_volume_from_snapshot" :: held 7.846s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90-2e350326-c9ad-447b-a25d-e26c47b11088" released by "_create_volume_from_snapshot" :: held 7.930s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.968s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.695s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978752535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987579f0-2859-47b6-8ae8-87d38c9a3271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056b74a5f2404d8fb7bdf0ac9d0214f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:35Z,use_quota=True,user_id='108c153ee518469c9408afdc26f10324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Creating volume 987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:42 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:42 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 1073741824
Sep 29 16:50:42 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032fe2c6-944b-492a-a1f9-968566820145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e350326-c9ad-447b-a25d-e26c47b11088', 'volume_size': 1, 'snapshot_id': '30c8c7fa-a0b4-438e-9830-d372c0f51a90'}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1e0922-26cc-4644-bf6d-cb39ab7ed2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:42 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Volume volume-2e350326-c9ad-447b-a25d-e26c47b11088 (2e350326-c9ad-447b-a25d-e26c47b11088): created successfully
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1e0922-26cc-4644-bf6d-cb39ab7ed2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Flow 'volume_create_manager' (59380a91-7e7f-45b6-b95d-1d398391aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:42 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a3293e35-e5b7-4e7c-a4c1-1695037e37f8 tempest-SnapshotDependencyTests-666180542 None] Created volume successfully.
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-30c8c7fa-a0b4-438e-9830-d372c0f51a90-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-30c8c7fa-a0b4-438e-9830-d372c0f51a90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Deleting offline snapshot 30c8c7fa-a0b4-438e-9830-d372c0f51a90 of volume 6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] snapshot_file for this snap is: volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e026515-fb83-4bdf-b187-e98e812d3b4e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:43 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:43 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:43 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 1073741824" returned: 0 in 0.447s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:43 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271
Sep 29 16:50:43 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:43 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f8a20-a7b3-45ee-b669-646d263f5d06]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:43 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.500s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Creating offline snapshot ef82b0d2-e3a3-4425-807c-6aecf8f1beaa of volume 7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019fa1a5-520f-427b-8781-7b6e67bbc70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987579f0-2859-47b6-8ae8-87d38c9a3271', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4d51a-25ff-4465-982d-d999bfa3686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa4c5ab-1406-4233-9c41-687df6a40f8d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:43 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Volume volume-987579f0-2859-47b6-8ae8-87d38c9a3271 (987579f0-2859-47b6-8ae8-87d38c9a3271): created successfully
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4d51a-25ff-4465-982d-d999bfa3686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Flow 'volume_create_manager' (9dcafe0a-824f-470e-be30-8a4db4980f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:43 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:43 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3d57e53f-975c-43e6-9721-e56630ab289b tempest-CinderUnicodeTest-666647752 None] Created volume successfully.
Sep 29 16:50:43 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125
Sep 29 16:50:43 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:44 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa 1G
Sep 29 16:50:44 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.553s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:44 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:44 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa 1G" returned: 0 in 0.401s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a156baa-f914-4152-84c2-a765a2520125 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:44 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a156baa-f914-4152-84c2-a765a2520125 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa
Sep 29 16:50:44 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.360s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:44 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90
Sep 29 16:50:44 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0.30c8c7fa-a0b4-438e-9830-d372c0f51a90" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a156baa-f914-4152-84c2-a765a2520125 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:44 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa is being set with open permissions: ugo+rw
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:44 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa
Sep 29 16:50:44 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-30c8c7fa-a0b4-438e-9830-d372c0f51a90" released by "_delete_snapshot" :: held 1.682s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" released by "delete_snapshot" :: held 1.715s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:44 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Created reservations ['b1580114-3ce5-455f-af39-2b64a42be443', 'f8263671-af79-4511-97ba-df65d2781754', '3959dff1-3246-4fcb-92b0-10d0ea335a53', 'd12d1764-75fc-441a-b0a9-6edc2ad3fc98'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Delete snapshot completed successfully.
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-00c29b33-b0a2-4610-b32c-b52869919419 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-30c8c7fa-a0b4-438e-9830-d372c0f51a90-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:45 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:45 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info
Sep 29 16:50:45 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-6a64c9b5-ac13-4494-8a6a-c92572a596a0-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-6a64c9b5-ac13-4494-8a6a-c92572a596a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:45 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info" returned: 0 in 0.281s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:45 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info is being set with open permissions: ugo+rw
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[76be9cf5-9ae8-4df0-8691-967969ed71c3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:45 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info
Sep 29 16:50:45 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:45 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:45 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:45 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.info" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.775s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103050462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c065d9c1-3938-428d-96a4-a73b8cb2dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:39Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Creating volume c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:45 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:45 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 1073741824
Sep 29 16:50:45 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-fe391a69-a76c-45d8-9620-4574c150e6aa tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:50:45 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:45 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0
Sep 29 16:50:45 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:46 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a64c9b5-ac13-4494-8a6a-c92572a596a0" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-6a64c9b5-ac13-4494-8a6a-c92572a596a0" released by "delete_volume" :: held 0.733s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Created reservations ['730e6b81-07fe-4b0d-9f7b-6d3977fc73b3', 'f0e78e76-9a02-4441-9ae5-a3ab3df366ff', '8326ff22-1273-4c24-889d-854f501eee5f', 'c8c04e9c-ec7d-41cb-882b-3abb0c986b72'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:46 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 1073741824" returned: 0 in 0.506s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:46 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:46 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:46 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9
Sep 29 16:50:46 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-2e350326-c9ad-447b-a25d-e26c47b11088-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:46 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.250s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-2e350326-c9ad-447b-a25d-e26c47b11088-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Deleted volume successfully.
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c9b0c83e-c78e-4197-bdf5-4765285903f6 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-6a64c9b5-ac13-4494-8a6a-c92572a596a0-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:46 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" returned: 0 in 0.295s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.503s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" acquired by "delete_volume" :: waited 0.037s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9936e7-7ecd-426a-9098-cb14e4b4d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ae6ac9-56ad-408b-af81-f427c7844498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa6567e-8cca-432d-85b9-f8ef5416ba2c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Creating offline snapshot dfc23180-729b-4eaa-b4cd-f687bf3fd9af of volume 987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Volume volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 (c065d9c1-3938-428d-96a4-a73b8cb2dfe9): created successfully
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ae6ac9-56ad-408b-af81-f427c7844498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (30f0cb5c-0fe2-4934-9622-b55595d5c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d69e14-9160-4acc-bcfe-baf551f2b8b0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-278285b3-2c91-4642-a22c-4b8e7f21e8c2 tempest-ProjectReaderTests-1575218624 None] Created volume successfully.
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:46 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088
Sep 29 16:50:46 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot ef82b0d2-e3a3-4425-807c-6aecf8f1beaa of volume 7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572e4d1-4a1f-491b-b93f-789ca92ea26a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:46 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271
Sep 29 16:50:46 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:46 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa
Sep 29 16:50:46 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088
Sep 29 16:50:47 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271" returned: 0 in 0.472s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af 1G
Sep 29 16:50:47 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" returned: 0 in 0.475s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a156baa-f914-4152-84c2-a765a2520125(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:47 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e350326-c9ad-447b-a25d-e26c47b11088" returned: 0 in 0.297s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32f08a-74a9-4fb3-945e-751b2c99b1d4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-quobyte-2e350326-c9ad-447b-a25d-e26c47b11088" released by "delete_volume" :: held 0.771s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Created reservations ['f4f981cd-7f38-4b71-bee0-0a90e5c6da82', '3f14f120-db6f-4f9c-9dfb-482137681aa1', 'a79638ef-c2cc-40e9-bdcc-1293462023dc', 'eef9bf4e-cf26-4158-9466-aedfd3a96bf2'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:47 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125
Sep 29 16:50:47 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:47 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af 1G" returned: 0 in 0.528s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987579f0-2859-47b6-8ae8-87d38c9a3271 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987579f0-2859-47b6-8ae8-87d38c9a3271 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af
Sep 29 16:50:47 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125" returned: 0 in 0.495s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.334s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:47 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Deleted volume successfully.
Sep 29 16:50:47 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa
Sep 29 16:50:47 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:47 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-def8e77b-cc45-458a-b0da-762612e7a2d1 tempest-SnapshotDependencyTests-666180542 None] Lock "cinder-2e350326-c9ad-447b-a25d-e26c47b11088-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:48 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-987579f0-2859-47b6-8ae8-87d38c9a3271 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af is being set with open permissions: ugo+rw
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:48 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af
Sep 29 16:50:48 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:48 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" returned: 0 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:48 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa
Sep 29 16:50:48 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:48 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af" returned: 0 in 0.268s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:48 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info
Sep 29 16:50:48 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:48 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125.ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa" released by "_delete_snapshot" :: held 1.789s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" released by "delete_snapshot" :: held 1.822s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:48 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info" returned: 0 in 0.286s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info is being set with open permissions: ugo+rw
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Created reservations ['bb11f94b-df32-4886-8bf6-8b72c0129bea', '6545e4ae-ec85-495a-89b9-1b2793f4a6c6', '9c387dd6-6659-41bb-b6ce-ff4b68d77780', '7f0eadc5-56af-4529-89fd-d3d5bd07177f'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:48 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info
Sep 29 16:50:48 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:48 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-62e164da-38e0-4b88-8050-ff31038db765 tempest-ProjectMemberTests-510067890 None] Lock "cinder-ef82b0d2-e3a3-4425-807c-6aecf8f1beaa-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-7a156baa-f914-4152-84c2-a765a2520125-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "cinder-7a156baa-f914-4152-84c2-a765a2520125-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:48 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.info" returned: 0 in 0.311s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eaa089-6561-42c0-9303-72eb728c26dc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.569s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Creating offline snapshot e9b402a4-997e-4095-83b3-e4c5c3055518 of volume c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-12731e6f-3cdb-4350-8097-79488b791f73 tempest-CinderUnicodeTest-666647752 None] Create snapshot completed successfully
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[196e0f19-2305-4f8f-a29c-e9a8df45dd6f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:49 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125
Sep 29 16:50:49 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:49 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9
Sep 29 16:50:49 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-dfc23180-729b-4eaa-b4cd-f687bf3fd9af-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-dfc23180-729b-4eaa-b4cd-f687bf3fd9af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-quobyte-dfc23180-729b-4eaa-b4cd-f687bf3fd9af" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-dfc23180-729b-4eaa-b4cd-f687bf3fd9af" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Deleting offline snapshot dfc23180-729b-4eaa-b4cd-f687bf3fd9af of volume 987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:49 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] snapshot_file for this snap is: volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884dae1-90c8-4082-9e01-f6e92ddacdde]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:49 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125
Sep 29 16:50:49 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:49 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" returned: 0 in 0.473s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:49 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 1G
Sep 29 16:50:49 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:49 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af
Sep 29 16:50:49 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:49 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-7a156baa-f914-4152-84c2-a765a2520125" returned: 0 in 0.406s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-7a156baa-f914-4152-84c2-a765a2520125" released by "delete_volume" :: held 0.977s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:49 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af" returned: 0 in 0.469s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-987579f0-2859-47b6-8ae8-87d38c9a3271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57c637c-6d3c-4217-bd26-f96cfc4ec4bd]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Created reservations ['919f6e8c-eb0d-4adc-8595-6aa8e0b0c3bb', '33ebf778-ab9a-4d79-9edd-7be2a19d434c', '06ca4bbd-8c33-4de8-8f26-08a2427a14be', 'b2a400e1-95cc-46ce-8e78-ed31e909b6ac'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:50 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 1G" returned: 0 in 0.623s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:50 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518
Sep 29 16:50:50 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271
Sep 29 16:50:50 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.294s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-d8220977-7e6d-4867-a19f-cc90feaddf4d tempest-ProjectMemberTests-510067890 None] Lock "cinder-7a156baa-f914-4152-84c2-a765a2520125-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:50 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:50 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 is being set with open permissions: ugo+rw
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271" returned: 0 in 0.602s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518
Sep 29 16:50:50 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af
Sep 29 16:50:50 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:50 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info
Sep 29 16:50:50 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:50 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af" returned: 0 in 0.396s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:51 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af
Sep 29 16:50:51 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:51 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:51 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info is being set with open permissions: ugo+rw
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:51 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info
Sep 29 16:50:51 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:51 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271.dfc23180-729b-4eaa-b4cd-f687bf3fd9af" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-dfc23180-729b-4eaa-b4cd-f687bf3fd9af" released by "_delete_snapshot" :: held 1.934s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" released by "delete_snapshot" :: held 1.992s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Created reservations ['72e93c88-2f1a-459d-8809-bd2064fe639a', 'bd47b421-1d82-4fcd-b63a-93868677247b', '688b176a-9086-42c4-a33a-6fe7208e188f', '30cd49f9-72c0-472e-a4eb-9b9f58ece87a'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Delete snapshot completed successfully.
Sep 29 16:50:51 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.info" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dd73fcc1-7f30-42f1-80e5-3658a15073a2 tempest-CinderUnicodeTest-666647752 None] Lock "cinder-dfc23180-729b-4eaa-b4cd-f687bf3fd9af-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:51 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-96df0b21-c9e0-4190-b4f1-a84b49bda887 tempest-ProjectReaderTests-1575218624 None] Create snapshot completed successfully
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (3706df5d-0633-44c7-97ea-4c46940b623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930306ad-51ff-44ea-afbe-60d3ffc67b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930306ad-51ff-44ea-afbe-60d3ffc67b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973867544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cb0d31-8080-4e84-96d9-b26074890c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:52Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60991951-2cfe-4663-8521-21b613ebf5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60991951-2cfe-4663-8521-21b613ebf5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529e7bd2-0f12-4142-ab9b-dc949a3b70c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529e7bd2-0f12-4142-ab9b-dc949a3b70c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cb0d31-8080-4e84-96d9-b26074890c07', 'volume_name': 'volume-14cb0d31-8080-4e84-96d9-b26074890c07', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cb2e85-e7e2-4f4d-89f6-a98bed9c495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cb2e85-e7e2-4f4d-89f6-a98bed9c495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b593d06-f918-46e6-824a-f4d67967daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:51 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Volume 14cb0d31-8080-4e84-96d9-b26074890c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cb0d31-8080-4e84-96d9-b26074890c07', 'volume_size': 1}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973867544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cb0d31-8080-4e84-96d9-b26074890c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:52Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Creating volume 14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:51 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:51 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 1073741824
Sep 29 16:50:51 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:52 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 1073741824" returned: 0 in 0.444s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:52 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07
Sep 29 16:50:52 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-987579f0-2859-47b6-8ae8-87d38c9a3271-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:52 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07" returned: 0 in 0.309s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "cinder-987579f0-2859-47b6-8ae8-87d38c9a3271-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b593d06-f918-46e6-824a-f4d67967daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cb0d31-8080-4e84-96d9-b26074890c07', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd24174c-100c-40d6-bcf2-64c3ca398fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:52 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Volume volume-14cb0d31-8080-4e84-96d9-b26074890c07 (14cb0d31-8080-4e84-96d9-b26074890c07): created successfully
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd24174c-100c-40d6-bcf2-64c3ca398fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (3706df5d-0633-44c7-97ea-4c46940b623d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e2b985cc-466c-4492-9301-bf808b88c696 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee0be4-ef07-4a17-808d-1a36ab4c1c3e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:52 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271
Sep 29 16:50:52 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-e9b402a4-997e-4095-83b3-e4c5c3055518-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-e9b402a4-997e-4095-83b3-e4c5c3055518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-e9b402a4-997e-4095-83b3-e4c5c3055518" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-e9b402a4-997e-4095-83b3-e4c5c3055518" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Deleting offline snapshot e9b402a4-997e-4095-83b3-e4c5c3055518 of volume c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] snapshot_file for this snap is: volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8b8911-c5bf-4e4d-bdb4-c3174c5d55d3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:53 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518
Sep 29 16:50:53 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:53 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271" returned: 0 in 0.418s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:53 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271
Sep 29 16:50:53 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:53 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518" returned: 0 in 0.374s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:53 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-987579f0-2859-47b6-8ae8-87d38c9a3271" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[18489f5e-8413-46c4-9c8e-3de535533175]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:53 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:53 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-987579f0-2859-47b6-8ae8-87d38c9a3271" released by "delete_volume" :: held 0.852s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:53 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9
Sep 29 16:50:53 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Created reservations ['f002c8fb-54f5-4f91-813d-ed6b4a126f88', '5ed419b1-6245-460b-9830-781460092fc8', '5a6a3cd6-3386-45a7-89aa-23353f4872b5', '55767ee5-532e-480e-8fa5-1dd8c751b3df'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:53 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:53 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:53 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 8468e742-2fa1-492a-8212-3343f59531f8 of volume 14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d56f0c-3e10-4927-90d8-49bb1a98827d]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:54 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" returned: 0 in 0.558s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:54 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518
Sep 29 16:50:54 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:54 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07
Sep 29 16:50:54 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:54 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.348s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:54 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Deleted volume successfully.
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-de9b8649-9c8e-45eb-bde8-896e0284364b tempest-CinderUnicodeTest-666647752 None] Lock "cinder-987579f0-2859-47b6-8ae8-87d38c9a3271-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:54 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:54 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07" returned: 0 in 0.445s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:54 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 1G
Sep 29 16:50:54 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:54 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518
Sep 29 16:50:54 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:54 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9.e9b402a4-997e-4095-83b3-e4c5c3055518" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-e9b402a4-997e-4095-83b3-e4c5c3055518" released by "_delete_snapshot" :: held 1.805s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" released by "delete_snapshot" :: held 1.848s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-05e74f33-397f-43a2-abc9-82a39159afdf-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "cinder-05e74f33-397f-43a2-abc9-82a39159afdf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:54 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Created reservations ['24fdf988-da5d-40bc-adaa-301734728f8b', '7f9e67b2-73ab-4491-980f-ec6eea187db9', '1da5244f-ee79-45f4-bf06-cf44d9a172f4', 'd9006bdd-5838-4086-bb4a-8886602df29c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Acquiring lock "cinder-quobyte-05e74f33-397f-43a2-abc9-82a39159afdf" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-05e74f33-397f-43a2-abc9-82a39159afdf" acquired by "delete_volume" :: waited 0.032s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:55 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Delete snapshot completed successfully.
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9bad35e4-bdf4-4d3e-abc6-a2b3842bea6e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-e9b402a4-997e-4095-83b3-e4c5c3055518-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f4e7a-215c-4c25-aa13-649886da0717]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 1G" returned: 0 in 0.591s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14cb0d31-8080-4e84-96d9-b26074890c07 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14cb0d31-8080-4e84-96d9-b26074890c07 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8
Sep 29 16:50:55 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-c065d9c1-3938-428d-96a4-a73b8cb2dfe9-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-c065d9c1-3938-428d-96a4-a73b8cb2dfe9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:55 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf
Sep 29 16:50:55 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64dff57-92c1-4064-86b8-4c6bc8837a23]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14cb0d31-8080-4e84-96d9-b26074890c07 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8" returned: 0 in 0.357s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:55 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 is being set with open permissions: ugo+rw
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9
Sep 29 16:50:55 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8
Sep 29 16:50:55 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf" returned: 0 in 0.567s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf
Sep 29 16:50:55 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8" returned: 0 in 0.330s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" returned: 0 in 0.470s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:55 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info
Sep 29 16:50:55 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9
Sep 29 16:50:55 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:55 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-05e74f33-397f-43a2-abc9-82a39159afdf" returned: 0 in 0.280s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "cinder-quobyte-05e74f33-397f-43a2-abc9-82a39159afdf" released by "delete_volume" :: held 0.914s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Created reservations ['c71e300d-77c4-4919-a43b-5f0ce25686a9', '205c7dc1-17ee-4890-aac9-608b91b45a6f', '866c3fc8-6b5b-4b92-ae93-7c2af9a86e83', 'd40ddbf2-4782-4d15-9808-fa8b06a080a1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:56 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info" returned: 0 in 0.303s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info is being set with open permissions: ugo+rw
Sep 29 16:50:56 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:56 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:56 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" returned: 0 in 0.322s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info
Sep 29 16:50:56 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-c065d9c1-3938-428d-96a4-a73b8cb2dfe9" released by "delete_volume" :: held 0.887s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Created reservations ['e9bcbb14-af3b-48a3-b5ec-e0268c64b623', '58f02686-6fb6-4625-b8f6-6df2e8011f0c', '679077fd-e4bd-4b5b-847c-51c7bdf1910a', '42e8d213-4fba-4c74-a20d-f30c1337aebf'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:56 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:50:56 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:56 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Deleted volume successfully.
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c61c8fae-94d7-4964-93b1-63827dce77de tempest-CinderUnicodeTest-666647752 None] Lock "cinder-05e74f33-397f-43a2-abc9-82a39159afdf-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:56 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.info" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-97727ca1-2143-41bb-8f8f-24763f87e46a tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:50:56 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:50:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Deleted volume successfully.
Sep 29 16:50:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-dc944bb4-17b7-44a4-873c-6d686c51585e tempest-ProjectReaderTests-1575218624 None] Lock "cinder-c065d9c1-3938-428d-96a4-a73b8cb2dfe9-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (2f0e6fcb-f516-4ba7-b487-ca2e5b1acbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8c77e7-53d4-47a1-9189-98becf285a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-8468e742-2fa1-492a-8212-3343f59531f8-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8c77e7-53d4-47a1-9189-98becf285a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275028706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ec858c-3c94-4617-9dcb-b9de6c25b42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:57Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0482eb-7321-464a-8457-13f5c7a957c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0482eb-7321-464a-8457-13f5c7a957c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e8f93-4e05-4206-8eb3-53d79bbaf1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e8f93-4e05-4206-8eb3-53d79bbaf1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ec858c-3c94-4617-9dcb-b9de6c25b42d', 'volume_name': 'volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9e877e-a21d-41f3-91e6-0bce0aa142f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9e877e-a21d-41f3-91e6-0bce0aa142f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb5cfe4-c07b-484f-9389-93087cc24083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:57 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Volume 89ec858c-3c94-4617-9dcb-b9de6c25b42d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d', 'volume_size': 1}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275028706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ec858c-3c94-4617-9dcb-b9de6c25b42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:57Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Creating volume 89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:50:57 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-8468e742-2fa1-492a-8212-3343f59531f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.125s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:57 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d 1073741824
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-8468e742-2fa1-492a-8212-3343f59531f8" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:50:57 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-8468e742-2fa1-492a-8212-3343f59531f8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 8468e742-2fa1-492a-8212-3343f59531f8 of volume 14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41d8039-f4c1-4f1f-810e-2c54575ec7b1]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:57 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8
Sep 29 16:50:57 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:57 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d 1073741824" returned: 0 in 0.581s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:57 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8" returned: 0 in 0.483s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:57 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14cb0d31-8080-4e84-96d9-b26074890c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3661eeef-1d09-471b-bb43-e866c6c51aee]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:58 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d
Sep 29 16:50:58 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:58 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07
Sep 29 16:50:58 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:58 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d" returned: 0 in 0.353s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb5cfe4-c07b-484f-9389-93087cc24083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34dde07-5cd0-41e5-ab1d-8e61504e4b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:50:58 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Volume volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d (89ec858c-3c94-4617-9dcb-b9de6c25b42d): created successfully
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34dde07-5cd0-41e5-ab1d-8e61504e4b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (2f0e6fcb-f516-4ba7-b487-ca2e5b1acbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:50:58 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-d94a6d21-d0b5-4943-a3f9-682de059301f tempest-ProjectReaderTests-1575218624 None] Created volume successfully.
Sep 29 16:50:58 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07" returned: 0 in 0.512s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:58 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8
Sep 29 16:50:58 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:58 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:58 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8
Sep 29 16:50:58 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:59 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07.8468e742-2fa1-492a-8212-3343f59531f8" returned: 0 in 0.279s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-8468e742-2fa1-492a-8212-3343f59531f8" released by "_delete_snapshot" :: held 1.874s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" released by "delete_snapshot" :: held 1.903s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Created reservations ['01bfabcd-aa4d-4bdb-a509-b620ddf1aaf6', 'cd86f344-aa86-4ddf-8e1a-989547f6c5f1', '7c5afc39-d3b0-4099-9a5e-570358f782a5', '7dda7b43-b8cb-4971-8ca9-755c5ecb1923'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:50:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a92fd811-68d3-4fe6-8889-b6d1164a1c64 tempest-ProjectMemberTests-510067890 None] Lock "cinder-8468e742-2fa1-492a-8212-3343f59531f8-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Creating offline snapshot 912739c7-2c5c-4452-ba6e-0d79e5db6236 of volume 89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c716c-0b52-4e32-9337-99118af2d403]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:50:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:50:59 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d
Sep 29 16:50:59 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:50:59 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:00 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 1G
Sep 29 16:51:00 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:00 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 1G" returned: 0 in 0.485s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:00 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236
Sep 29 16:51:00 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-14cb0d31-8080-4e84-96d9-b26074890c07-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "cinder-14cb0d31-8080-4e84-96d9-b26074890c07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd800c-df16-4047-a0ac-e8675534ed18]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:00 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07
Sep 29 16:51:00 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:00 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236" returned: 0 in 0.377s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:00 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 is being set with open permissions: ugo+rw
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:00 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236
Sep 29 16:51:00 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:00 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-2c18c654-e5be-424f-8afd-cbb52fa0ae4c tempest-ProjectAdminTests-1707709405 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86843) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 16:51:01 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07" returned: 0 in 0.400s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:01 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236" returned: 0 in 0.309s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07
Sep 29 16:51:01 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:01 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info
Sep 29 16:51:01 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:01 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-14cb0d31-8080-4e84-96d9-b26074890c07" returned: 0 in 0.281s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-14cb0d31-8080-4e84-96d9-b26074890c07" released by "delete_volume" :: held 0.757s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:01 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Created reservations ['d23e7252-2a6c-4266-8761-14992c0bfd47', '14555d43-accc-49e9-8e58-98f0080a4ebb', '16a10047-27f8-4401-ae39-2f2ebc1d4d8a', 'cbf49b46-3977-4068-a91b-9c6a98c4c1b4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info" returned: 0 in 0.301s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info is being set with open permissions: ugo+rw
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:01 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info
Sep 29 16:51:01 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:01 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:01 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:01 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.info" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0d890be5-cae7-43e6-986a-97976deaa6d0 tempest-ProjectReaderTests-1575218624 None] Create snapshot completed successfully
Sep 29 16:51:01 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:01 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:01 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-41478cab-8835-4229-beff-fd898d12f676 tempest-ProjectMemberTests-510067890 None] Lock "cinder-14cb0d31-8080-4e84-96d9-b26074890c07-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (ce5d55b1-94b9-4373-b9fa-3c573737319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e776ca-ba43-43d2-9009-cde303864892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e776ca-ba43-43d2-9009-cde303864892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69669453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a787692-1622-4fea-9a20-e3b8e84dea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:02Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca21e169-fb66-49de-af94-863fdbdbbcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca21e169-fb66-49de-af94-863fdbdbbcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b739f8e-e7bc-4cf2-b1e7-0435c3c5c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b739f8e-e7bc-4cf2-b1e7-0435c3c5c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a787692-1622-4fea-9a20-e3b8e84dea9b', 'volume_name': 'volume-6a787692-1622-4fea-9a20-e3b8e84dea9b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be84db1-ba1e-4a73-b40a-ee8095218d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be84db1-ba1e-4a73-b40a-ee8095218d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c80d94-14e8-4216-bcbc-ce5935fa78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:02 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Volume 6a787692-1622-4fea-9a20-e3b8e84dea9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a787692-1622-4fea-9a20-e3b8e84dea9b', 'volume_size': 1}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69669453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a787692-1622-4fea-9a20-e3b8e84dea9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:02Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Creating volume 6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:02 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:02 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b 1073741824
Sep 29 16:51:02 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-912739c7-2c5c-4452-ba6e-0d79e5db6236-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-912739c7-2c5c-4452-ba6e-0d79e5db6236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-912739c7-2c5c-4452-ba6e-0d79e5db6236" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-912739c7-2c5c-4452-ba6e-0d79e5db6236" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Deleting offline snapshot 912739c7-2c5c-4452-ba6e-0d79e5db6236 of volume 89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] snapshot_file for this snap is: volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d521a8-a75c-465d-8225-d09df8cc88e4]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:02 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b 1073741824" returned: 0 in 0.536s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:02 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:03 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b
Sep 29 16:51:03 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:03 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236
Sep 29 16:51:03 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:03 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b" returned: 0 in 0.283s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c80d94-14e8-4216-bcbc-ce5935fa78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a787692-1622-4fea-9a20-e3b8e84dea9b', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f42c94-b986-44ef-9efb-bbcd382d4afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Volume volume-6a787692-1622-4fea-9a20-e3b8e84dea9b (6a787692-1622-4fea-9a20-e3b8e84dea9b): created successfully
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f42c94-b986-44ef-9efb-bbcd382d4afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (ce5d55b1-94b9-4373-b9fa-3c573737319b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:03 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-cfcdc2b2-8f81-4979-bfee-0da86f57f40c tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236" returned: 0 in 0.414s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b948a9e4-6b93-4240-8f7b-4d208f71078a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:03 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d
Sep 29 16:51:03 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:03 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d" returned: 0 in 0.407s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:03 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236
Sep 29 16:51:03 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:04 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236" returned: 0 in 0.368s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:04 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236
Sep 29 16:51:04 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:04 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d.912739c7-2c5c-4452-ba6e-0d79e5db6236" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-912739c7-2c5c-4452-ba6e-0d79e5db6236" released by "_delete_snapshot" :: held 1.568s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" released by "delete_snapshot" :: held 1.602s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Created reservations ['7f53caf1-3415-4a17-8793-381d6a6d8da8', '2c513ae6-0fdf-4b2e-ace5-b2eb3d83b069', '79d2ccff-411c-4033-85a9-14b3036e58d1', 'd166aa4c-7241-4a5c-be86-71ea93aa06c4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Creating offline snapshot eb267274-954a-4355-b7dc-16b1df816cba of volume 6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b6b3ee-9af6-406d-90ac-7cf7b0ac43ec]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:04 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Delete snapshot completed successfully.
Sep 29 16:51:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8aa77f36-5415-40d1-9bed-d31998861f14 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-912739c7-2c5c-4452-ba6e-0d79e5db6236-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:04 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b
Sep 29 16:51:04 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-89ec858c-3c94-4617-9dcb-b9de6c25b42d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-89ec858c-3c94-4617-9dcb-b9de6c25b42d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:05 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b" returned: 0 in 0.438s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:05 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba 1G
Sep 29 16:51:05 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4053a-1164-4613-8043-d277afd76721]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:05 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d
Sep 29 16:51:05 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba 1G" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a787692-1622-4fea-9a20-e3b8e84dea9b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:05 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a787692-1622-4fea-9a20-e3b8e84dea9b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba
Sep 29 16:51:05 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d" returned: 0 in 0.437s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:05 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d
Sep 29 16:51:05 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a787692-1622-4fea-9a20-e3b8e84dea9b -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba" returned: 0 in 0.323s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:05 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba is being set with open permissions: ugo+rw
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:05 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba
Sep 29 16:51:05 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:05 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-89ec858c-3c94-4617-9dcb-b9de6c25b42d" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-89ec858c-3c94-4617-9dcb-b9de6c25b42d" released by "delete_volume" :: held 0.810s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:05 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Created reservations ['982e5bec-8e2b-42e7-9ac2-b1d0781d2a86', '00e90520-dad0-43b3-a844-bf123aafd1fe', 'a1b748c6-37e8-4514-9dc1-3bc1a63bada0', '8827dd32-9069-4734-bc62-1a13edde5311'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:06 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:06 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:06 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba" returned: 0 in 0.281s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:06 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info
Sep 29 16:51:06 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:06 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.312s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Deleted volume successfully.
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-2277941d-b69e-4533-a120-4cb09e917847 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-89ec858c-3c94-4617-9dcb-b9de6c25b42d-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:06 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info" returned: 0 in 0.288s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:06 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info is being set with open permissions: ugo+rw
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:06 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info
Sep 29 16:51:06 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:06 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.info" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (15ca11c7-3d43-4867-8f34-828d3d97de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee25f546-defd-4da2-9469-c094f1726f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee25f546-defd-4da2-9469-c094f1726f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789304255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23c7dd-851d-435e-a88d-5b178916254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:07Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0504bb-b45f-41e7-af3f-3dd2da176cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0504bb-b45f-41e7-af3f-3dd2da176cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9c97b1-2d55-4137-adf6-01898a54d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9c97b1-2d55-4137-adf6-01898a54d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed23c7dd-851d-435e-a88d-5b178916254f', 'volume_name': 'volume-ed23c7dd-851d-435e-a88d-5b178916254f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84de52d8-0f9a-4e68-a59e-4840c89ba3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84de52d8-0f9a-4e68-a59e-4840c89ba3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c3defd-91a1-488a-9a27-c18d492af609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Volume ed23c7dd-851d-435e-a88d-5b178916254f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed23c7dd-851d-435e-a88d-5b178916254f', 'volume_size': 1}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789304255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23c7dd-851d-435e-a88d-5b178916254f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:07Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Creating volume ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:06 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-92280ebb-f4b3-4d6f-b8e3-c8d2e475d126 tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:06 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f 1073741824
Sep 29 16:51:06 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:07 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f 1073741824" returned: 0 in 0.455s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:07 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f
Sep 29 16:51:07 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:07 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f" returned: 0 in 0.245s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c3defd-91a1-488a-9a27-c18d492af609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed23c7dd-851d-435e-a88d-5b178916254f', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6083ed8-44e7-49f4-8a4a-fbf2246b0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:07 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Volume volume-ed23c7dd-851d-435e-a88d-5b178916254f (ed23c7dd-851d-435e-a88d-5b178916254f): created successfully
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6083ed8-44e7-49f4-8a4a-fbf2246b0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (15ca11c7-3d43-4867-8f34-828d3d97de06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:07 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-15be8a55-e0cb-4367-a039-ca9051a636a3 tempest-ProjectReaderTests-1575218624 None] Created volume successfully.
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-eb267274-954a-4355-b7dc-16b1df816cba-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-eb267274-954a-4355-b7dc-16b1df816cba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-eb267274-954a-4355-b7dc-16b1df816cba" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-eb267274-954a-4355-b7dc-16b1df816cba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot eb267274-954a-4355-b7dc-16b1df816cba of volume 6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[04802ea8-0b66-4d53-b328-81d2f439d966]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:07 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba
Sep 29 16:51:07 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:08 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba" returned: 0 in 0.347s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a787692-1622-4fea-9a20-e3b8e84dea9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c2105-d8cd-4316-a221-31fec1a9a7cf]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:08 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b
Sep 29 16:51:08 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:08 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b" returned: 0 in 0.385s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:08 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba
Sep 29 16:51:08 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:09 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Creating offline snapshot 288d1e86-b7a7-45e8-9270-463a549fd5a3 of volume ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba" returned: 0 in 0.443s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[94367fe2-5791-4d28-a529-3be9a6d5cf3a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:09 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba
Sep 29 16:51:09 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:09 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f
Sep 29 16:51:09 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:09 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b.eb267274-954a-4355-b7dc-16b1df816cba" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-eb267274-954a-4355-b7dc-16b1df816cba" released by "_delete_snapshot" :: held 1.548s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" released by "delete_snapshot" :: held 1.570s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Created reservations ['5b1b82d4-4e84-4f5e-bd13-27abdd032759', '8fa87972-f10a-46ba-85fe-c50606e4080a', 'a53a8a9c-84f8-43d5-b2bc-ddbea61d682e', '58935272-9365-48d4-8f96-066cb8569fd8'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:09 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f" returned: 0 in 0.414s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:09 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 1G
Sep 29 16:51:09 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e4d263a9-1150-4317-bab5-8d2d01ecdd30 tempest-ProjectMemberTests-510067890 None] Lock "cinder-eb267274-954a-4355-b7dc-16b1df816cba-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:09 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 1G" returned: 0 in 0.384s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed23c7dd-851d-435e-a88d-5b178916254f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:09 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed23c7dd-851d-435e-a88d-5b178916254f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3
Sep 29 16:51:09 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-6a787692-1622-4fea-9a20-e3b8e84dea9b-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "cinder-6a787692-1622-4fea-9a20-e3b8e84dea9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:10 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed23c7dd-851d-435e-a88d-5b178916254f -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3" returned: 0 in 0.315s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:10 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 is being set with open permissions: ugo+rw
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedb288-cb69-4626-bc04-266a0d38a2cc]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:10 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3
Sep 29 16:51:10 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b
Sep 29 16:51:10 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:10 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info
Sep 29 16:51:10 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:10 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b
Sep 29 16:51:10 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info" returned: 0 in 0.296s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:10 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info is being set with open permissions: ugo+rw
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:10 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info
Sep 29 16:51:10 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:10 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-6a787692-1622-4fea-9a20-e3b8e84dea9b" returned: 0 in 0.270s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-6a787692-1622-4fea-9a20-e3b8e84dea9b" released by "delete_volume" :: held 0.735s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Created reservations ['e673bcbe-82ca-4bbc-bbfa-a19fb52c96b0', '87881d9a-1963-4471-a6e9-4cd73934a046', '368f964a-2e8b-4cd3-b4e5-85eeb53a6b32', 'a7713f21-13d2-4fb0-84cd-8aaecb7c869d'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:11 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:11 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:11 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.info" returned: 0 in 0.308s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-da84744b-e047-419f-aeb8-75eac849de68 tempest-ProjectReaderTests-1575218624 None] Create snapshot completed successfully
Sep 29 16:51:11 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8559141c-4aae-40cd-8988-ce651471045e tempest-ProjectMemberTests-510067890 None] Lock "cinder-6a787692-1622-4fea-9a20-e3b8e84dea9b-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (023d5133-be1b-4f3c-be3b-0a9504d67cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a9dc0e-9140-421e-a1f0-2247c84890ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a9dc0e-9140-421e-a1f0-2247c84890ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095280688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fcbb1b-779d-4451-9abb-f5a4e4569639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:12Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d84d3-33f0-4e4b-84b2-211ac76e4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780d84d3-33f0-4e4b-84b2-211ac76e4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f875b64-9e6e-4043-8afe-12c0293ee4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f875b64-9e6e-4043-8afe-12c0293ee4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6fcbb1b-779d-4451-9abb-f5a4e4569639', 'volume_name': 'volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c4152d-e7b0-4a5f-b4aa-e8c3b7f6a6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c4152d-e7b0-4a5f-b4aa-e8c3b7f6a6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b84b5c-8f38-4229-a1f2-0368545c0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Volume e6fcbb1b-779d-4451-9abb-f5a4e4569639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639', 'volume_size': 1}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095280688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fcbb1b-779d-4451-9abb-f5a4e4569639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:12Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Creating volume e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:11 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:11 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 1073741824
Sep 29 16:51:11 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-288d1e86-b7a7-45e8-9270-463a549fd5a3-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-288d1e86-b7a7-45e8-9270-463a549fd5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-288d1e86-b7a7-45e8-9270-463a549fd5a3" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-288d1e86-b7a7-45e8-9270-463a549fd5a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Deleting offline snapshot 288d1e86-b7a7-45e8-9270-463a549fd5a3 of volume ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:12 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] snapshot_file for this snap is: volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 1073741824" returned: 0 in 0.549s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad6c7d7-5ea6-41a0-880f-1c6a1f099df8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:12 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639
Sep 29 16:51:12 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:12 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3
Sep 29 16:51:12 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:12 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639" returned: 0 in 0.270s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b84b5c-8f38-4229-a1f2-0368545c0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07635d01-342a-4cb6-bbdf-947aa62519df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:12 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Volume volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 (e6fcbb1b-779d-4451-9abb-f5a4e4569639): created successfully
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07635d01-342a-4cb6-bbdf-947aa62519df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (023d5133-be1b-4f3c-be3b-0a9504d67cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:12 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a36a2a6a-9a22-4e3b-8410-438bbe1b28a5 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:12 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3" returned: 0 in 0.433s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed23c7dd-851d-435e-a88d-5b178916254f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b84f8-89f7-415c-b25a-3f7faf0f33e5]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:12 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f
Sep 29 16:51:12 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:13 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:13 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3
Sep 29 16:51:13 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:13 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3" returned: 0 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:13 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3
Sep 29 16:51:13 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f.288d1e86-b7a7-45e8-9270-463a549fd5a3" returned: 0 in 0.276s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-288d1e86-b7a7-45e8-9270-463a549fd5a3" released by "_delete_snapshot" :: held 1.597s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" released by "delete_snapshot" :: held 1.624s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Created reservations ['e7738b37-64dc-456e-96c4-41ba6dcce5fc', '0cd8544a-dd3c-42d1-a7fb-da4087c15024', 'd9f10d0d-79b7-4abc-a1eb-c32bb34dd9ac', '4ecbe8cf-b590-487a-9778-87d2b87de8ec'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 08d300b1-3a0c-4dfc-8026-7a456165510d of volume e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d337075-8b6d-4c27-9807-9caefeb2ddd7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:14 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Delete snapshot completed successfully.
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-8e933aa5-fbf0-4ec8-b4db-b67e07d24f56 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-288d1e86-b7a7-45e8-9270-463a549fd5a3-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:14 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639
Sep 29 16:51:14 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-ed23c7dd-851d-435e-a88d-5b178916254f-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "cinder-ed23c7dd-851d-435e-a88d-5b178916254f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:14 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639" returned: 0 in 0.432s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:14 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d 1G
Sep 29 16:51:14 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" acquired by "delete_volume" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f443f-7048-41a2-9c8d-5bf087a66a0a]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:14 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:14 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f
Sep 29 16:51:14 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d 1G" returned: 0 in 0.497s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d
Sep 29 16:51:15 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f" returned: 0 in 0.456s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f
Sep 29 16:51:15 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d" returned: 0 in 0.302s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d is being set with open permissions: ugo+rw
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ed23c7dd-851d-435e-a88d-5b178916254f" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d
Sep 29 16:51:15 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-ed23c7dd-851d-435e-a88d-5b178916254f" released by "delete_volume" :: held 0.798s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Created reservations ['e0b90e33-34da-44e6-ab2c-3d14b09a92a2', '86d458d7-241c-498e-9ef5-9daa6aa62533', 'ce28e800-9f33-413b-9a99-8560e2c0d909', '1e351cad-404c-4927-8eb4-f984d037fd84'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:15 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d" returned: 0 in 0.264s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info
Sep 29 16:51:15 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:15 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.274s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:15 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Deleted volume successfully.
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-554dfb23-baac-47c0-a18b-bf77755092ed tempest-ProjectReaderTests-1575218624 None] Lock "cinder-ed23c7dd-851d-435e-a88d-5b178916254f-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:15 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info" returned: 0 in 0.313s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:15 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info is being set with open permissions: ugo+rw
Sep 29 16:51:15 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:15 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info
Sep 29 16:51:15 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (69854f18-1fcc-4f6b-9966-74a11f7541cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39eae38-3cce-4a65-8e82-196cd3d89081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39eae38-3cce-4a65-8e82-196cd3d89081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690504768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109ae86d-4d8c-4457-811f-cf91e2719ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:16Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09b3b0f-1f4b-4167-84a3-a388b546f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:16 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09b3b0f-1f4b-4167-84a3-a388b546f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8569c75-93cc-49ad-839d-bbf429b41f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8569c75-93cc-49ad-839d-bbf429b41f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109ae86d-4d8c-4457-811f-cf91e2719ae0', 'volume_name': 'volume-109ae86d-4d8c-4457-811f-cf91e2719ae0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aec2df2-d9d0-4949-b259-0640d7132ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aec2df2-d9d0-4949-b259-0640d7132ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d94a8e5-8dfe-4f50-b95c-687369e48cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:16 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Volume 109ae86d-4d8c-4457-811f-cf91e2719ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109ae86d-4d8c-4457-811f-cf91e2719ae0', 'volume_size': 1}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.info" returned: 0 in 0.326s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690504768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109ae86d-4d8c-4457-811f-cf91e2719ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:16Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Creating volume 109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:16 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:16 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 1073741824
Sep 29 16:51:16 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:16 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c2f0245a-0688-411e-8993-bb972dbb5b2b tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:16 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 1073741824" returned: 0 in 0.462s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:16 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:16 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0
Sep 29 16:51:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:17 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0" returned: 0 in 0.255s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d94a8e5-8dfe-4f50-b95c-687369e48cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109ae86d-4d8c-4457-811f-cf91e2719ae0', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3f9dc7-c2dc-4ceb-b7d7-6a97a2107bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:17 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Volume volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 (109ae86d-4d8c-4457-811f-cf91e2719ae0): created successfully
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3f9dc7-c2dc-4ceb-b7d7-6a97a2107bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (69854f18-1fcc-4f6b-9966-74a11f7541cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:17 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-58ace197-a8f3-4f94-942e-ca3f1f70a066 tempest-ProjectReaderTests-1575218624 None] Created volume successfully.
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-08d300b1-3a0c-4dfc-8026-7a456165510d-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-08d300b1-3a0c-4dfc-8026-7a456165510d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-08d300b1-3a0c-4dfc-8026-7a456165510d" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-08d300b1-3a0c-4dfc-8026-7a456165510d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 08d300b1-3a0c-4dfc-8026-7a456165510d of volume e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b223d38-dc32-43e7-a144-6253738c74b6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:17 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d
Sep 29 16:51:17 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:17 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d" returned: 0 in 0.358s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[68972988-b44a-448d-ab8f-9eca942c4d83]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:17 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:17 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639
Sep 29 16:51:17 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:18 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639" returned: 0 in 0.380s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:18 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d
Sep 29 16:51:18 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Creating offline snapshot 86841951-783f-46da-ad7d-f9450d1a123d of volume 109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[663f32de-fdca-4af8-bd50-acab21dc5953]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:18 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d" returned: 0 in 0.425s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:18 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d
Sep 29 16:51:18 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:18 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0
Sep 29 16:51:18 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:18 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639.08d300b1-3a0c-4dfc-8026-7a456165510d" returned: 0 in 0.284s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-08d300b1-3a0c-4dfc-8026-7a456165510d" released by "_delete_snapshot" :: held 1.561s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" released by "delete_snapshot" :: held 1.584s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:18 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0" returned: 0 in 0.417s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Created reservations ['24dbf370-9b04-41f2-9b6f-6eb494ff2ab6', 'ed1d0397-e479-478b-a5f8-49f3f823fbbb', 'dfc246e0-5dbd-4d0a-8f89-f36d1d778e2f', '9800113d-94a5-4bce-90d4-c95c14d5e840'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:18 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d 1G
Sep 29 16:51:18 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:18 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:18 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ac901621-d5e5-41e3-b45f-a76b04ce03ea tempest-ProjectMemberTests-510067890 None] Lock "cinder-08d300b1-3a0c-4dfc-8026-7a456165510d-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:19 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d 1G" returned: 0 in 0.478s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-e6fcbb1b-779d-4451-9abb-f5a4e4569639-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "cinder-e6fcbb1b-779d-4451-9abb-f5a4e4569639-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:19 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d
Sep 29 16:51:19 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c45efb-c5f9-4567-9d53-eb53fc06c771]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:19 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639
Sep 29 16:51:19 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:19 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d" returned: 0 in 0.419s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:19 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d is being set with open permissions: ugo+rw
Sep 29 16:51:19 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:19 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d
Sep 29 16:51:19 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:20 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639" returned: 0 in 0.452s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:20 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639
Sep 29 16:51:20 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:20 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d" returned: 0 in 0.321s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:20 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info
Sep 29 16:51:20 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:20 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-e6fcbb1b-779d-4451-9abb-f5a4e4569639" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-e6fcbb1b-779d-4451-9abb-f5a4e4569639" released by "delete_volume" :: held 0.819s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Created reservations ['cda2899d-c8dc-415c-9413-b5bbc6092fc8', '79a45ca4-820e-4676-ac32-195350ad1bda', '58c3e66f-5553-41ce-b296-b35478a7210f', '3f29fa46-40c9-467c-a8b9-d0471e4d42c5'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:20 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info" returned: 0 in 0.291s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info is being set with open permissions: ugo+rw
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:20 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info
Sep 29 16:51:20 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:20 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:20 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:20 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.info" returned: 0 in 0.342s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-48f57db9-70ef-4156-aee8-fe5fdd068bd3 tempest-ProjectReaderTests-1575218624 None] Create snapshot completed successfully
Sep 29 16:51:20 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:20 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:20 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c76c9393-e6f1-4484-b279-f62403f7bfba tempest-ProjectMemberTests-510067890 None] Lock "cinder-e6fcbb1b-779d-4451-9abb-f5a4e4569639-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (1cb80abb-7d17-4e51-9469-9b0cc6557087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7462e1b7-3a6a-4642-b81a-9496cbb27cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7462e1b7-3a6a-4642-b81a-9496cbb27cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573951940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cbe4ec-dc47-4f41-9b76-8dfa631f4a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:21Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46f0b2f-8f5c-478f-a3e1-10898a4c7fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46f0b2f-8f5c-478f-a3e1-10898a4c7fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e195a70-bc97-4e2b-950f-ff56452cb2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e195a70-bc97-4e2b-950f-ff56452cb2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cbe4ec-dc47-4f41-9b76-8dfa631f4a22', 'volume_name': 'volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c676073-d5b0-4c7b-9635-16fcb8b41e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c676073-d5b0-4c7b-9635-16fcb8b41e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb275ee-b25e-4d07-a338-1d2720878b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:21 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Volume 59cbe4ec-dc47-4f41-9b76-8dfa631f4a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22', 'volume_size': 1}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573951940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cbe4ec-dc47-4f41-9b76-8dfa631f4a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:21Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Creating volume 59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:21 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:21 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 1073741824
Sep 29 16:51:21 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-86841951-783f-46da-ad7d-f9450d1a123d-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-86841951-783f-46da-ad7d-f9450d1a123d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-86841951-783f-46da-ad7d-f9450d1a123d" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-86841951-783f-46da-ad7d-f9450d1a123d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Deleting offline snapshot 86841951-783f-46da-ad7d-f9450d1a123d of volume 109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] snapshot_file for this snap is: volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858974a-0692-4bd1-90cd-d551180874d9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:21 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 1073741824" returned: 0 in 0.532s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:21 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:21 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d
Sep 29 16:51:21 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:21 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22
Sep 29 16:51:21 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:22 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" returned: 0 in 0.285s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb275ee-b25e-4d07-a338-1d2720878b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:22 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a490021c-a5ad-49d3-b914-f41e64ea113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d" returned: 0 in 0.415s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ae86d-4d8c-4457-811f-cf91e2719ae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:22 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Volume volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 (59cbe4ec-dc47-4f41-9b76-8dfa631f4a22): created successfully
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a490021c-a5ad-49d3-b914-f41e64ea113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (1cb80abb-7d17-4e51-9469-9b0cc6557087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304607e-01e4-4a26-8864-5ba73229b36e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:22 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-76f935a6-3514-4241-98b8-85b37ca13bf7 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:22 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0
Sep 29 16:51:22 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:22 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0" returned: 0 in 0.375s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:22 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d
Sep 29 16:51:22 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:22 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d" returned: 0 in 0.381s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:22 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:22 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d
Sep 29 16:51:22 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:23 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0.86841951-783f-46da-ad7d-f9450d1a123d" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-86841951-783f-46da-ad7d-f9450d1a123d" released by "_delete_snapshot" :: held 1.576s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" released by "delete_snapshot" :: held 1.609s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Created reservations ['0c15c089-c08b-4790-ab74-e47d2c8674a8', '77630bfd-7412-4458-a993-9e4153de38e8', '11c8b78f-ae90-47d5-b705-8eb8894dde74', '95ce90bd-f2ad-48f4-bc57-219eb39f9117'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:23 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Delete snapshot completed successfully.
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-1b1f8fd5-bc96-4a37-856c-d27478f82777 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-86841951-783f-46da-ad7d-f9450d1a123d-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 382d5c78-a60e-4040-a4b8-5678f08ad085 of volume 59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6b4f65-2b3b-47e6-a1e7-0ed745be9837]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:23 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22
Sep 29 16:51:23 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-109ae86d-4d8c-4457-811f-cf91e2719ae0-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-109ae86d-4d8c-4457-811f-cf91e2719ae0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:23 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" returned: 0 in 0.447s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0160578-90a6-49f8-95f6-bf5280dea483]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:23 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:23 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 1G
Sep 29 16:51:23 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:24 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0
Sep 29 16:51:24 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:24 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0" returned: 0 in 0.428s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:24 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 1G" returned: 0 in 0.460s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:24 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0
Sep 29 16:51:24 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:24 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085
Sep 29 16:51:24 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:24 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-109ae86d-4d8c-4457-811f-cf91e2719ae0" returned: 0 in 0.289s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-109ae86d-4d8c-4457-811f-cf91e2719ae0" released by "delete_volume" :: held 0.803s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Created reservations ['0dd9a7e5-79a0-4c56-b3c8-1a334908fbc2', '92007db7-08b4-4c18-acaf-9df5becfd8d7', '7a1d1da7-a3a6-4fe7-9f4d-bae4c11ffa4a', '09ff6751-0c03-4fa5-8774-3a0c9557dd72'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:24 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085" returned: 0 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:24 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 is being set with open permissions: ugo+rw
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:24 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085
Sep 29 16:51:24 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:24 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:24 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:24 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:25 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:25 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info
Sep 29 16:51:25 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:25 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.332s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Deleted volume successfully.
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-50711e16-be5f-4954-9e64-146c8c05c5b1 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-109ae86d-4d8c-4457-811f-cf91e2719ae0-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:25 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info" returned: 0 in 0.337s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:25 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info is being set with open permissions: ugo+rw
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:25 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info
Sep 29 16:51:25 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (a337d72b-6171-449c-b275-b51137fbefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9976bb6a-78f4-4d50-b201-38825a80faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9976bb6a-78f4-4d50-b201-38825a80faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296665514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e60796-4983-4f89-b7ca-9415103b4970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96014bda-4b48-426d-ab31-c6f7067f1787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96014bda-4b48-426d-ab31-c6f7067f1787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbaccf0-c1d9-4309-aea3-bb1ee4432a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbaccf0-c1d9-4309-aea3-bb1ee4432a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e60796-4983-4f89-b7ca-9415103b4970', 'volume_name': 'volume-56e60796-4983-4f89-b7ca-9415103b4970', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fe0148-ce5c-45a2-a061-5808e3d3cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fe0148-ce5c-45a2-a061-5808e3d3cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4208e706-132f-4f78-bb3e-5a6e57ba41c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:25 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Volume 56e60796-4983-4f89-b7ca-9415103b4970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e60796-4983-4f89-b7ca-9415103b4970', 'volume_size': 1}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:25 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.info" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296665514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e60796-4983-4f89-b7ca-9415103b4970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9565648b76e4db3ba7fbfe42ba1c7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='9ffc8b7149114fd08e3bb58e9f0309e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Creating volume 56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:25 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:25 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:25 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 1073741824
Sep 29 16:51:25 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:25 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-8e27ac37-97ba-4635-b6cd-1e48383952dd tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:26 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 1073741824" returned: 0 in 0.414s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:26 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970
Sep 29 16:51:26 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:26 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970" returned: 0 in 0.245s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4208e706-132f-4f78-bb3e-5a6e57ba41c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e60796-4983-4f89-b7ca-9415103b4970', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e94cc1-77b8-47a0-947b-a14f0c5d8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:26 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Volume volume-56e60796-4983-4f89-b7ca-9415103b4970 (56e60796-4983-4f89-b7ca-9415103b4970): created successfully
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e94cc1-77b8-47a0-947b-a14f0c5d8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Flow 'volume_create_manager' (a337d72b-6171-449c-b275-b51137fbefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:26 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-84fc4003-b5b5-4884-80be-d76e850abf5d tempest-ProjectReaderTests-1575218624 None] Created volume successfully.
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-382d5c78-a60e-4040-a4b8-5678f08ad085-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-382d5c78-a60e-4040-a4b8-5678f08ad085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-382d5c78-a60e-4040-a4b8-5678f08ad085" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-382d5c78-a60e-4040-a4b8-5678f08ad085" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 382d5c78-a60e-4040-a4b8-5678f08ad085 of volume 59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bc2d51-4504-4e45-8185-e5f51f6863c3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:26 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:26 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085
Sep 29 16:51:26 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:27 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085" returned: 0 in 0.359s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[750dd1fb-3e21-4c56-a499-9d85265f00b2]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:27 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22
Sep 29 16:51:27 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:27 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" returned: 0 in 0.367s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:27 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085
Sep 29 16:51:27 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Creating offline snapshot 83b714a0-b547-4de6-8a3e-19afeb8b3794 of volume 56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:27 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085" returned: 0 in 0.383s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c7dbfb-e0ed-4481-a143-c47892783361]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:27 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:27 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085
Sep 29 16:51:27 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:28 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970
Sep 29 16:51:28 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:28 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22.382d5c78-a60e-4040-a4b8-5678f08ad085" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-382d5c78-a60e-4040-a4b8-5678f08ad085" released by "_delete_snapshot" :: held 1.463s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" released by "delete_snapshot" :: held 1.490s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Created reservations ['4016ab7d-03b9-42d4-b7c3-1796539832c0', '41013481-304d-422c-9930-db2a7a865473', '4110e2cd-e6a7-42dd-be7b-6b14b3998627', '1d966c18-7705-498f-99c6-85fd5012e3bd'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:28 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:28 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970" returned: 0 in 0.393s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c7ec5a65-7125-4644-b630-6b24d8270927 tempest-ProjectMemberTests-510067890 None] Lock "cinder-382d5c78-a60e-4040-a4b8-5678f08ad085-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:28 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 1G
Sep 29 16:51:28 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:28 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 1G" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e60796-4983-4f89-b7ca-9415103b4970 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:28 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e60796-4983-4f89-b7ca-9415103b4970 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794
Sep 29 16:51:28 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "cinder-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f998b13d-6b1d-4770-842e-cc79934832a9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:28 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e60796-4983-4f89-b7ca-9415103b4970 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794" returned: 0 in 0.329s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 is being set with open permissions: ugo+rw
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794
Sep 29 16:51:29 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22
Sep 29 16:51:29 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info
Sep 29 16:51:29 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22
Sep 29 16:51:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info is being set with open permissions: ugo+rw
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info
Sep 29 16:51:29 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22" released by "delete_volume" :: held 0.705s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Created reservations ['b1d95e62-6fab-4f85-a6d5-4df486995576', 'daf3cfab-75c0-4526-ba62-43982681a206', 'ad935e3d-cc56-42b8-92ca-0f81e9848860', 'd92e7427-2460-4ad2-b791-1f78831f10e9'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:29 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:29 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:29 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.info" returned: 0 in 0.259s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:29 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:29 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-016fd147-4de8-4169-8223-02c3effb5865 tempest-ProjectReaderTests-1575218624 None] Create snapshot completed successfully
Sep 29 16:51:30 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.258s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:30 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-b1351db6-20d8-4f3e-b9a1-4ea1f514348e tempest-ProjectMemberTests-510067890 None] Lock "cinder-59cbe4ec-dc47-4f41-9b76-8dfa631f4a22-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (7b75f058-3e43-40fa-a3d8-a3c3976c450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a89ab7-bf43-407b-aa28-916d681e862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a89ab7-bf43-407b-aa28-916d681e862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350262378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f32e6d-300b-4764-83d0-440190a4ef44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:30Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20047b53-0b77-45bd-b44a-4f0b93384283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20047b53-0b77-45bd-b44a-4f0b93384283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8b6641-f8ce-4bda-a6a8-a56d1f89ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8b6641-f8ce-4bda-a6a8-a56d1f89ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f32e6d-300b-4764-83d0-440190a4ef44', 'volume_name': 'volume-22f32e6d-300b-4764-83d0-440190a4ef44', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1473b0f-b287-4175-a514-5ed5ac93a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1473b0f-b287-4175-a514-5ed5ac93a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29648515-f9b4-492c-a53f-35e30bd74d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:30 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Volume 22f32e6d-300b-4764-83d0-440190a4ef44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f32e6d-300b-4764-83d0-440190a4ef44', 'volume_size': 1}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350262378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f32e6d-300b-4764-83d0-440190a4ef44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:30Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Creating volume 22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:30 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:30 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 1073741824
Sep 29 16:51:30 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:30 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 1073741824" returned: 0 in 0.426s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:30 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-83b714a0-b547-4de6-8a3e-19afeb8b3794-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-83b714a0-b547-4de6-8a3e-19afeb8b3794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:31 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44
Sep 29 16:51:31 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-83b714a0-b547-4de6-8a3e-19afeb8b3794" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-83b714a0-b547-4de6-8a3e-19afeb8b3794" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Deleting offline snapshot 83b714a0-b547-4de6-8a3e-19afeb8b3794 of volume 56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] snapshot_file for this snap is: volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4ff51-58a6-45da-85f0-ef07607c8ee9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:31 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794
Sep 29 16:51:31 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:31 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44" returned: 0 in 0.266s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=179,cinder:UPDATE=239,cinder:INSERT=63,cinder:DELETE=15 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29648515-f9b4-492c-a53f-35e30bd74d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f32e6d-300b-4764-83d0-440190a4ef44', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab91e9ff-a13d-4768-8f0f-77a781cf426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=181,cinder:DELETE=23,cinder:UPDATE=208,cinder:INSERT=59 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:51:31 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Volume volume-22f32e6d-300b-4764-83d0-440190a4ef44 (22f32e6d-300b-4764-83d0-440190a4ef44): created successfully
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab91e9ff-a13d-4768-8f0f-77a781cf426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (7b75f058-3e43-40fa-a3d8-a3c3976c450e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:31 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0c58a053-2d2d-4d54-9f83-dfe81524deae tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:31 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794" returned: 0 in 0.388s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e60796-4983-4f89-b7ca-9415103b4970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0ca09-0cbe-4ece-aba1-91f6862960c7]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:31 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970
Sep 29 16:51:31 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 9c63b075-6e50-4a0b-bf3e-81139e0c951c of volume 22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f36208-20f0-48b5-a3f0-a8589a5c8f9c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:31 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44
Sep 29 16:51:31 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:31 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970" returned: 0 in 0.404s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:31 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:31 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794
Sep 29 16:51:31 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:32 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:32 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c 1G
Sep 29 16:51:32 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:32 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794" returned: 0 in 0.336s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:32 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794
Sep 29 16:51:32 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:32 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c 1G" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f32e6d-300b-4764-83d0-440190a4ef44 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:32 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970.83b714a0-b547-4de6-8a3e-19afeb8b3794" returned: 0 in 0.245s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:32 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f32e6d-300b-4764-83d0-440190a4ef44 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c
Sep 29 16:51:32 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-83b714a0-b547-4de6-8a3e-19afeb8b3794" released by "_delete_snapshot" :: held 1.500s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" released by "delete_snapshot" :: held 1.524s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Created reservations ['420a83a9-fbf2-45f3-ac19-2a43c053ad5a', 'b9ae3acf-3d9f-410e-a397-257052eed2d8', 'd35eec29-25f0-45cf-9a27-e9d62d684c18', 'cbbcc376-cff5-4e23-9043-c16027fc8cb6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:32 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Delete snapshot completed successfully.
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-ed02fe1b-96fa-47e0-b6d7-7fc2f8b1facd tempest-ProjectReaderTests-1575218624 None] Lock "cinder-83b714a0-b547-4de6-8a3e-19afeb8b3794-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:32 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f32e6d-300b-4764-83d0-440190a4ef44 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c" returned: 0 in 0.287s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:32 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c is being set with open permissions: ugo+rw
Sep 29 16:51:32 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:32 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c
Sep 29 16:51:32 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:33 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c" returned: 0 in 0.244s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:33 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info
Sep 29 16:51:33 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-56e60796-4983-4f89-b7ca-9415103b4970-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-56e60796-4983-4f89-b7ca-9415103b4970-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" acquired by "delete_volume" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2473658-e798-47fe-a562-03780bbf0cc1]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:33 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info" returned: 0 in 0.275s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:33 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info is being set with open permissions: ugo+rw
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:33 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info
Sep 29 16:51:33 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:33 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970
Sep 29 16:51:33 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:33 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.info" returned: 0 in 0.248s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:33 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4affa079-71de-4c91-9e18-c396134cdc1e tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:33 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:33 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970
Sep 29 16:51:33 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-9c63b075-6e50-4a0b-bf3e-81139e0c951c-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-9c63b075-6e50-4a0b-bf3e-81139e0c951c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-9c63b075-6e50-4a0b-bf3e-81139e0c951c" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-9c63b075-6e50-4a0b-bf3e-81139e0c951c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 9c63b075-6e50-4a0b-bf3e-81139e0c951c of volume 22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72d35e-4e83-4200-b465-cdd240d111e3]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:33 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-56e60796-4983-4f89-b7ca-9415103b4970" returned: 0 in 0.273s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:33 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-quobyte-56e60796-4983-4f89-b7ca-9415103b4970" released by "delete_volume" :: held 0.746s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Created reservations ['4b6830ed-f42e-4d0b-8ea0-13bff82c3cea', '76171c2c-2c5a-40f3-b4ef-62e155555033', '12940386-4941-4f8d-a882-c8fba5f5f15f', '44a4dee8-0634-4aeb-a54c-72e8f3e20689'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:34 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c
Sep 29 16:51:34 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:34 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:34 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:34 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c" returned: 0 in 0.412s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f32e6d-300b-4764-83d0-440190a4ef44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:34 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.272s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:34 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Deleted volume successfully.
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[237aba87-21a3-48f5-a7fa-6cb3725c899f]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9b05a77d-2082-4d25-94e5-dc7d67c977a8 tempest-ProjectReaderTests-1575218624 None] Lock "cinder-56e60796-4983-4f89-b7ca-9415103b4970-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:34 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44
Sep 29 16:51:34 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:34 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44" returned: 0 in 0.398s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:34 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:34 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c
Sep 29 16:51:34 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:35 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:35 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c
Sep 29 16:51:35 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:35 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44.9c63b075-6e50-4a0b-bf3e-81139e0c951c" returned: 0 in 0.263s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-9c63b075-6e50-4a0b-bf3e-81139e0c951c" released by "_delete_snapshot" :: held 1.572s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" released by "delete_snapshot" :: held 1.601s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Created reservations ['ada0437d-0bf0-4af9-83d4-2ce611db8ecb', 'af8d2cbc-707f-4505-bcb3-87c312fd05d4', '6c9d2eee-68fd-4371-807f-62467c71228e', 'd41f2a86-70a6-4e73-ad04-8490b1629cf8'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:35 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:35 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9feb4d64-a052-4e7b-8a6d-29df6147cba8 tempest-ProjectMemberTests-510067890 None] Lock "cinder-9c63b075-6e50-4a0b-bf3e-81139e0c951c-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-22f32e6d-300b-4764-83d0-440190a4ef44-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "cinder-22f32e6d-300b-4764-83d0-440190a4ef44-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60cdd47-2426-415f-a366-1614cf967de0]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:36 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44
Sep 29 16:51:36 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:36 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:36 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44
Sep 29 16:51:36 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:36 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-22f32e6d-300b-4764-83d0-440190a4ef44" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-22f32e6d-300b-4764-83d0-440190a4ef44" released by "delete_volume" :: held 0.691s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Created reservations ['dc642612-0664-4ea0-ad97-7cbe541947d0', 'b1bbe0e0-018f-47ec-a358-5c4a0921f2ed', '142b6126-557f-4568-82ca-38fd697fdd51', '445eb78a-4e62-4cae-ba2a-a35ef2202d48'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:36 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:36 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:36 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:37 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.268s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:37 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-e27cd2dc-f40e-454a-9d42-a156ab5e3009 tempest-ProjectMemberTests-510067890 None] Lock "cinder-22f32e6d-300b-4764-83d0-440190a4ef44-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (2f0a1984-8517-42ac-bc2c-ec1daccbfab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9cf411-285e-422e-bdd9-b41052770b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9cf411-285e-422e-bdd9-b41052770b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089046900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4f43fe-cf9c-4736-823d-83da6fa3ad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:38Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57933266-1f8e-40c0-9a6b-08662a67a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57933266-1f8e-40c0-9a6b-08662a67a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b52ca16-0121-4187-98d9-7e855ff1074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b52ca16-0121-4187-98d9-7e855ff1074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4f43fe-cf9c-4736-823d-83da6fa3ad22', 'volume_name': 'volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8998d388-f98c-4f9d-a948-041aeaea14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8998d388-f98c-4f9d-a948-041aeaea14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e8475c-74a4-4812-93ae-ed118b6d8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:37 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Volume ab4f43fe-cf9c-4736-823d-83da6fa3ad22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22', 'volume_size': 1}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089046900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4f43fe-cf9c-4736-823d-83da6fa3ad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:38Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Creating volume ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:37 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:37 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:37 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 1073741824
Sep 29 16:51:37 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Flow 'volume_create_manager' (d6cf066a-ce37-450f-ab33-e9d27e5f4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcddb9f1-d286-49ef-a53d-48746e5d1648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcddb9f1-d286-49ef-a53d-48746e5d1648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185327003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cacf95e-cb37-4e5e-b6f8-bc088eb07002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f9d88b78de4918bb8efff8eef410cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:38Z,use_quota=True,user_id='fcc87ee2874e4ce1990498bab83b2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f920a2d5-fb9c-4d89-8797-3d827edc7402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f920a2d5-fb9c-4d89-8797-3d827edc7402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15dc394-9c7a-4972-932d-8dfce2b3d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15dc394-9c7a-4972-932d-8dfce2b3d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cacf95e-cb37-4e5e-b6f8-bc088eb07002', 'volume_name': 'volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa4f21-0ad3-4934-a509-ed92f3fe33bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa4f21-0ad3-4934-a509-ed92f3fe33bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29345f0-fa75-4b29-8390-d17e99e78726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Volume 9cacf95e-cb37-4e5e-b6f8-bc088eb07002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002', 'volume_size': 1}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 1073741824" returned: 0 in 0.521s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:38 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22
Sep 29 16:51:38 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:38 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" returned: 0 in 0.254s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185327003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cacf95e-cb37-4e5e-b6f8-bc088eb07002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f9d88b78de4918bb8efff8eef410cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:38Z,use_quota=True,user_id='fcc87ee2874e4ce1990498bab83b2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Creating volume 9cacf95e-cb37-4e5e-b6f8-bc088eb07002 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:38 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e8475c-74a4-4812-93ae-ed118b6d8072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 1073741824
Sep 29 16:51:38 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06556d-f64e-4510-a131-195d304af34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:38 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Volume volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 (ab4f43fe-cf9c-4736-823d-83da6fa3ad22): created successfully
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06556d-f64e-4510-a131-195d304af34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:38 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (2f0a1984-8517-42ac-bc2c-ec1daccbfab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:38 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4091aca2-a2d4-4404-8cda-9d2e7d5c8248 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:39 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 1073741824" returned: 0 in 0.423s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:39 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002
Sep 29 16:51:39 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:39 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" returned: 0 in 0.253s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29345f0-fa75-4b29-8390-d17e99e78726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cb131-32f4-4b94-8778-d7056d4a24fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:39 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Volume volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 (9cacf95e-cb37-4e5e-b6f8-bc088eb07002): created successfully
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4cb131-32f4-4b94-8778-d7056d4a24fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Flow 'volume_create_manager' (d6cf066a-ce37-450f-ab33-e9d27e5f4e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:39 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6b09f53b-c179-4cd4-abe6-9ffcd79d5c2d tempest-ProjectReaderTests-1619740095 None] Created volume successfully.
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 0ea13a73-3c59-4e25-88db-fc52415175c7 of volume ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3352ee29-cc48-4e62-b93b-c819ddcd8dbe]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:39 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:40 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22
Sep 29 16:51:40 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:40 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" returned: 0 in 0.379s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:40 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 1G
Sep 29 16:51:40 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Acquiring lock "cinder-9cacf95e-cb37-4e5e-b6f8-bc088eb07002-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "cinder-9cacf95e-cb37-4e5e-b6f8-bc088eb07002-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Acquiring lock "cinder-quobyte-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "cinder-quobyte-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bb10e-76f9-46a8-a71a-3a01440e34f8]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:40 devstack sudo[107786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002
Sep 29 16:51:40 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:40 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 1G" returned: 0 in 0.432s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:40 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7
Sep 29 16:51:40 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:40 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" returned: 0 in 0.378s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:40 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:40 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002
Sep 29 16:51:40 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:41 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7" returned: 0 in 0.306s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 is being set with open permissions: ugo+rw
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:41 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7
Sep 29 16:51:41 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:41 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" returned: 0 in 0.261s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "cinder-quobyte-9cacf95e-cb37-4e5e-b6f8-bc088eb07002" released by "delete_volume" :: held 0.685s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Created reservations ['8a3faa91-0d1b-4076-84a8-55763a04323b', '4c853046-c00f-4403-97c0-865d3adb9ab7', '4ce38fc2-9e15-4085-8794-c593c3df5717', 'd2b76ff6-3b93-4a9e-afc0-f07398cad8d7'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:41 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7" returned: 0 in 0.260s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:41 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info
Sep 29 16:51:41 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:41 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:41 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:41 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info" returned: 0 in 0.271s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info is being set with open permissions: ugo+rw
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:41 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info
Sep 29 16:51:41 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:41 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.268s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Deleted volume successfully.
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-59196856-7aa1-4733-93db-6689586e511f tempest-ProjectReaderTests-1619740095 None] Lock "cinder-9cacf95e-cb37-4e5e-b6f8-bc088eb07002-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:41 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.info" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:41 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:41 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-6afb9f22-d50a-4b4b-8103-855bd6752966 tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-0ea13a73-3c59-4e25-88db-fc52415175c7-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-0ea13a73-3c59-4e25-88db-fc52415175c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-0ea13a73-3c59-4e25-88db-fc52415175c7" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-0ea13a73-3c59-4e25-88db-fc52415175c7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 0ea13a73-3c59-4e25-88db-fc52415175c7 of volume ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Flow 'volume_create_manager' (931457f3-907b-49b3-a774-779929e457b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a608c67-cb08-483a-a00a-5f1848a8036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3849ec4-4209-480d-b719-8f148bbb4a3c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a608c67-cb08-483a-a00a-5f1848a8036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976558035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83b90f8-ec6f-4e41-bc4c-fd56efb35625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f9d88b78de4918bb8efff8eef410cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:42Z,use_quota=True,user_id='fcc87ee2874e4ce1990498bab83b2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe51867-2714-4dfc-9aaf-7ccfc0777564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe51867-2714-4dfc-9aaf-7ccfc0777564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddb4f2b-3be2-4c10-b08b-c8ae1ada97e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddb4f2b-3be2-4c10-b08b-c8ae1ada97e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83b90f8-ec6f-4e41-bc4c-fd56efb35625', 'volume_name': 'volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42abadcc-297b-4fbe-84cb-32e083f16d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42abadcc-297b-4fbe-84cb-32e083f16d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e205fda9-1c01-4536-aef1-35d68077ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:42 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Volume c83b90f8-ec6f-4e41-bc4c-fd56efb35625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625', 'volume_size': 1}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976558035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83b90f8-ec6f-4e41-bc4c-fd56efb35625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f9d88b78de4918bb8efff8eef410cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:42Z,use_quota=True,user_id='fcc87ee2874e4ce1990498bab83b2768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Creating volume c83b90f8-ec6f-4e41-bc4c-fd56efb35625 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:42 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:42 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 1073741824
Sep 29 16:51:42 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:42 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7
Sep 29 16:51:42 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:42 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7" returned: 0 in 0.382s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6af763-800d-4106-a001-62eb10b435ca]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:42 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 1073741824" returned: 0 in 0.457s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:42 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22
Sep 29 16:51:42 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:42 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625
Sep 29 16:51:42 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:42 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:42 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" returned: 0 in 0.392s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:43 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7
Sep 29 16:51:43 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:43 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" returned: 0 in 0.256s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e205fda9-1c01-4536-aef1-35d68077ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c917f-81f7-450c-a92a-19f3386b79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:43 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Volume volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 (c83b90f8-ec6f-4e41-bc4c-fd56efb35625): created successfully
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c917f-81f7-450c-a92a-19f3386b79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Flow 'volume_create_manager' (931457f3-907b-49b3-a774-779929e457b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-38bbc6f0-da02-4875-b173-63cf07ee211f tempest-ProjectReaderTests-1619740095 None] Created volume successfully.
Sep 29 16:51:43 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7" returned: 0 in 0.331s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:43 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7
Sep 29 16:51:43 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:43 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22.0ea13a73-3c59-4e25-88db-fc52415175c7" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-0ea13a73-3c59-4e25-88db-fc52415175c7" released by "_delete_snapshot" :: held 1.481s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" released by "delete_snapshot" :: held 1.516s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Created reservations ['a0d6f567-5ba8-4dd4-9953-69f3620b9510', '407e0a2c-bb9a-4607-92c8-e1540e07b765', '91ab84af-f2a7-43d0-968f-49c1c4ed97fd', 'bbb3be05-9ee2-4d33-b4e5-ab186e755274'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:43 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:43 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-a7a3a79f-54b3-4767-8189-987588d4a377 tempest-ProjectMemberTests-510067890 None] Lock "cinder-0ea13a73-3c59-4e25-88db-fc52415175c7-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-ab4f43fe-cf9c-4736-823d-83da6fa3ad22-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "cinder-ab4f43fe-cf9c-4736-823d-83da6fa3ad22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Acquiring lock "cinder-c83b90f8-ec6f-4e41-bc4c-fd56efb35625-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "cinder-c83b90f8-ec6f-4e41-bc4c-fd56efb35625-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Acquiring lock "cinder-quobyte-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" acquired by "delete_volume" :: waited 0.023s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "cinder-quobyte-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" acquired by "delete_volume" :: waited 0.044s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[60748dd1-bf31-4bc2-9d9a-e68accbc901b]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ef133-7fd1-429a-8821-e5afff187b68]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:44 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22
Sep 29 16:51:44 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:44 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625
Sep 29 16:51:44 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:44 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" returned: 0 in 0.373s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:44 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" returned: 0 in 0.366s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:44 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:44 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22
Sep 29 16:51:44 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:44 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625
Sep 29 16:51:44 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:45 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:45 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" returned: 0 in 0.244s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" returned: 0 in 0.265s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-ab4f43fe-cf9c-4736-823d-83da6fa3ad22" released by "delete_volume" :: held 0.705s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "cinder-quobyte-c83b90f8-ec6f-4e41-bc4c-fd56efb35625" released by "delete_volume" :: held 0.677s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Created reservations ['81263928-94df-411a-880d-915e1e3eda1e', '9c0fae37-fc26-459f-a294-7eaa96ea164d', 'b423d760-b08c-42d9-977c-6f4d52358cad', '71831be1-f82b-48b4-9e98-7a92f56d8b98'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Created reservations ['e758ed4e-0539-443a-85c3-71ae09558442', '2dfa50d7-22fe-4561-81b4-9001b6238ac5', 'a6b233f1-9ac0-45d0-851d-775c47ac3691', 'd097a7c2-8685-4870-a00c-fedcd8d4e6f4'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:45 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:45 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:45 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:45 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:45 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.307s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Deleted volume successfully.
Sep 29 16:51:45 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.286s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:45 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-3e3d806a-6751-4b6f-8cc5-6c09809ccbd6 tempest-ProjectReaderTests-1619740095 None] Lock "cinder-c83b90f8-ec6f-4e41-bc4c-fd56efb35625-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-43e96820-40fb-4eb8-bd3e-7c90f9f9d669 tempest-ProjectMemberTests-510067890 None] Lock "cinder-ab4f43fe-cf9c-4736-823d-83da6fa3ad22-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (3f41a4fa-9c93-456d-9446-c478f5482ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de1aef0-355c-49e0-9cca-24ab15c93420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de1aef0-355c-49e0-9cca-24ab15c93420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535107337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb3d537-f251-4dc4-b90f-76619d65a332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:46Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef8df62-71ba-4ad5-a79a-4ffee7d15f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:45 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef8df62-71ba-4ad5-a79a-4ffee7d15f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c12718c-eae4-4c76-938c-b7522bd6ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c12718c-eae4-4c76-938c-b7522bd6ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb3d537-f251-4dc4-b90f-76619d65a332', 'volume_name': 'volume-abb3d537-f251-4dc4-b90f-76619d65a332', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d76c7-01c4-439f-9452-280d267e0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d76c7-01c4-439f-9452-280d267e0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35c08f9-01cd-4c7e-9d94-f32c6b92b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Volume abb3d537-f251-4dc4-b90f-76619d65a332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb3d537-f251-4dc4-b90f-76619d65a332', 'volume_size': 1}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535107337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb3d537-f251-4dc4-b90f-76619d65a332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:46Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Creating volume abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:46 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:46 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 1073741824
Sep 29 16:51:46 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:46 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 1073741824" returned: 0 in 0.463s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:46 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332
Sep 29 16:51:46 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:46 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35c08f9-01cd-4c7e-9d94-f32c6b92b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb3d537-f251-4dc4-b90f-76619d65a332', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8cd180-8daf-4824-a5d7-bf42e59ba72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:46 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Volume volume-abb3d537-f251-4dc4-b90f-76619d65a332 (abb3d537-f251-4dc4-b90f-76619d65a332): created successfully
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8cd180-8daf-4824-a5d7-bf42e59ba72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:46 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (3f41a4fa-9c93-456d-9446-c478f5482ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:46 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4443ffc9-a30b-4583-9d46-75cf0241d847 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 2d18713a-e6ba-43da-b3df-5741d22d0b59 of volume abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f0c47-9ed7-4678-a3d2-12afc7e31cc6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:47 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332
Sep 29 16:51:47 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:47 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332" returned: 0 in 0.369s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:47 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 1G
Sep 29 16:51:47 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:47 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 1G" returned: 0 in 0.384s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:47 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb3d537-f251-4dc4-b90f-76619d65a332 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:47 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb3d537-f251-4dc4-b90f-76619d65a332 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59
Sep 29 16:51:47 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:48 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb3d537-f251-4dc4-b90f-76619d65a332 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59" returned: 0 in 0.285s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:48 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 is being set with open permissions: ugo+rw
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:48 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59
Sep 29 16:51:48 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:48 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59" returned: 0 in 0.257s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:48 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info
Sep 29 16:51:48 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:48 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:48 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info is being set with open permissions: ugo+rw
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:48 devstack sudo[107897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info
Sep 29 16:51:48 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:48 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.info" returned: 0 in 0.239s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:48 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:49 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-89ff5d14-6331-49d5-bcbe-b4fc57171730 tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-2d18713a-e6ba-43da-b3df-5741d22d0b59-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-2d18713a-e6ba-43da-b3df-5741d22d0b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-2d18713a-e6ba-43da-b3df-5741d22d0b59" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-2d18713a-e6ba-43da-b3df-5741d22d0b59" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 2d18713a-e6ba-43da-b3df-5741d22d0b59 of volume abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be68d07-6c7b-4866-aa0b-d940763bb5f6]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:49 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59
Sep 29 16:51:49 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:49 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59" returned: 0 in 0.356s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abb3d537-f251-4dc4-b90f-76619d65a332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fd775-f13e-4cb0-95cf-e4cc9418df61]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:49 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:49 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332
Sep 29 16:51:49 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:50 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332" returned: 0 in 0.362s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:50 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59
Sep 29 16:51:50 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:50 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59" returned: 0 in 0.352s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:50 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59
Sep 29 16:51:50 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:50 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332.2d18713a-e6ba-43da-b3df-5741d22d0b59" returned: 0 in 0.264s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-2d18713a-e6ba-43da-b3df-5741d22d0b59" released by "_delete_snapshot" :: held 1.418s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" released by "delete_snapshot" :: held 1.440s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Created reservations ['e2d10a6e-1599-4444-bca2-7267fe117930', '86a17867-1122-4b5d-ae94-328ee5f3ea1a', '8e4af6f9-c00a-480e-8125-a9f1b8013e7a', 'd4851be6-25af-466d-b7fa-5d0f9ddfef6c'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:50 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:50 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-119e2196-c905-4f3b-abfd-2a9caf1db9cd tempest-ProjectMemberTests-510067890 None] Lock "cinder-2d18713a-e6ba-43da-b3df-5741d22d0b59-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-abb3d537-f251-4dc4-b90f-76619d65a332-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "cinder-abb3d537-f251-4dc4-b90f-76619d65a332-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" acquired by "delete_volume" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[554f9322-23a4-4c8a-9141-71cd8b13c43e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:51 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332
Sep 29 16:51:51 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:51 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:51 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:51 devstack sudo[107965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332
Sep 29 16:51:51 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:52 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-abb3d537-f251-4dc4-b90f-76619d65a332" returned: 0 in 0.245s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-abb3d537-f251-4dc4-b90f-76619d65a332" released by "delete_volume" :: held 0.654s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Created reservations ['7332bf1a-6d4c-44e9-967f-27415545dd61', 'acbfcd09-03f5-4030-9300-4516d755931f', '248de8bd-325c-4bce-84c3-b6b3ebfc6d08', '95f0366d-a5bc-4f34-8caa-a80b01dc02c1'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:52 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:52 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:52 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.240s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:52 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:52 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-4baf6d46-7cde-4b0c-9810-dc94002d2143 tempest-ProjectMemberTests-510067890 None] Lock "cinder-abb3d537-f251-4dc4-b90f-76619d65a332-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (63c490b4-3177-4e70-8f26-7a82caa27700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e7114-4cfd-4712-8abf-31343d2b0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e7114-4cfd-4712-8abf-31343d2b0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585699771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1407c0f-c5ca-4033-a400-9e6e036d32c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4028cd80-2f23-4d89-9438-7c7474c1c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4028cd80-2f23-4d89-9438-7c7474c1c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d80885-1aae-4a16-853d-4df5eb0abcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d80885-1aae-4a16-853d-4df5eb0abcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1407c0f-c5ca-4033-a400-9e6e036d32c3', 'volume_name': 'volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efba9a-2d02-4b98-a8a6-c5a0645e8ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68efba9a-2d02-4b98-a8a6-c5a0645e8ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d7d2f-dfdc-4fdc-a328-18f6ddd4c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Volume d1407c0f-c5ca-4033-a400-9e6e036d32c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3', 'volume_size': 1}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585699771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1407c0f-c5ca-4033-a400-9e6e036d32c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef4117f42245dd8ef2eb586eb10b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='314445c6705e40558f70857ad2f1701d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Creating volume d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:51:53 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:53 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 1073741824
Sep 29 16:51:53 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:53 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 1073741824" returned: 0 in 0.402s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:53 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:53 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:53 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3
Sep 29 16:51:53 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:53 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_service.periodic_task [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] Running periodic task VolumeManager._thread_info {{(pid=86843) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread count: 28 {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-c6bd3284-5fce-4119-87e1-0a3b8edc2a88 None None] thread info: [<_MainThread(MainThread, started 129059459715200)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129059346385792)>, <Thread(Thread-3 (stat_writer), started daemon 129059346570816)>, <Thread(Rabbit-heartbeat, started daemon 129059380332672)>, <Thread(Thread-5 (_runner), started daemon 129059343648832)>, <Thread(Thread-7 (_runner), started daemon 129059343782400)>, <Thread(fd_logger, started daemon 129059341297664)>, <Thread(privsep_reader, started daemon 129059343326336)>, <Thread(tpool_thread_0, started daemon 129059334956736)>, <Thread(tpool_thread_1, started daemon 129059326547648)>, <Thread(tpool_thread_2, started daemon 129059318138560)>, <Thread(tpool_thread_3, started daemon 129059309729472)>, <Thread(tpool_thread_4, started daemon 129059301320384)>, <Thread(tpool_thread_5, started daemon 129059292911296)>, <Thread(tpool_thread_6, started daemon 129059284502208)>, <Thread(tpool_thread_7, started daemon 129059276093120)>, <Thread(tpool_thread_8, started daemon 129059267684032)>, <Thread(tpool_thread_9, started daemon 129059259274944)>, <Thread(tpool_thread_10, started daemon 129059250865856)>, <Thread(tpool_thread_11, started daemon 129059242456768)>, <Thread(tpool_thread_12, started daemon 129059234047680)>, <Thread(tpool_thread_13, started daemon 129059225638592)>, <Thread(tpool_thread_14, started daemon 129059217229504)>, <Thread(tpool_thread_15, started daemon 129059208820416)>, <Thread(tpool_thread_16, started daemon 129059200411328)>, <Thread(tpool_thread_17, started daemon 129059192002240)>, <Thread(tpool_thread_18, started daemon 129059183593152)>, <Thread(tpool_thread_19, started daemon 129059175184064)>] {{(pid=86843) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 16:51:53 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3" returned: 0 in 0.272s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d7d2f-dfdc-4fdc-a328-18f6ddd4c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5f7e9-0076-47fb-b40b-5bcda06f49c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:51:53 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Volume volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 (d1407c0f-c5ca-4033-a400-9e6e036d32c3): created successfully
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5f7e9-0076-47fb-b40b-5bcda06f49c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:51:53 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Flow 'volume_create_manager' (63c490b4-3177-4e70-8f26-7a82caa27700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:51:53 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bb3a30fa-5068-47f3-b2c2-28769690d359 tempest-ProjectMemberTests-510067890 None] Created volume successfully.
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Creating offline snapshot 64e2f192-d9b1-4866-bbdd-7b626b99cbfa of volume d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0726bc-fe31-476d-ad6d-4b6754930d10]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:54 devstack sudo[107984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3
Sep 29 16:51:54 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:54 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3" returned: 0 in 0.349s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa 1G {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:54 devstack sudo[107989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa 1G
Sep 29 16:51:54 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:54 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa 1G" returned: 0 in 0.389s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:54 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:55 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa
Sep 29 16:51:55 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:55 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 -F qcow2 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa" returned: 0 in 0.299s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:55 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa is being set with open permissions: ugo+rw
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:55 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa
Sep 29 16:51:55 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:55 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:55 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info
Sep 29 16:51:55 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:55 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info" returned: 0 in 0.244s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:55 devstack cinder-volume[86843]: WARNING cinder.volume.drivers.remotefs [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info is being set with open permissions: ugo+rw
Sep 29 16:51:55 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:55 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info
Sep 29 16:51:55 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:56 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.info" returned: 0 in 0.236s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:56 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-0127c5c9-92cf-4ee3-8f8e-05538bac7b43 tempest-ProjectMemberTests-510067890 None] Create snapshot completed successfully
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-64e2f192-d9b1-4866-bbdd-7b626b99cbfa-delete_snapshot" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-64e2f192-d9b1-4866-bbdd-7b626b99cbfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" by "delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-64e2f192-d9b1-4866-bbdd-7b626b99cbfa" by "_delete_snapshot" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-64e2f192-d9b1-4866-bbdd-7b626b99cbfa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Deleting offline snapshot 64e2f192-d9b1-4866-bbdd-7b626b99cbfa of volume d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] snapshot_file for this snap is: volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678c699-2c45-46b5-8bb8-f44a4174cad9]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:56 devstack sudo[108008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa
Sep 29 16:51:56 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:56 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa" returned: 0 in 0.355s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86843) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48a25f-f311-4145-b488-74c45d533212]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:56 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:56 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3
Sep 29 16:51:56 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:57 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3" returned: 0 in 0.358s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:57 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa
Sep 29 16:51:57 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:57 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa" returned: 0 in 0.338s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:57 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa
Sep 29 16:51:57 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:57 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3.64e2f192-d9b1-4866-bbdd-7b626b99cbfa" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-64e2f192-d9b1-4866-bbdd-7b626b99cbfa" released by "_delete_snapshot" :: held 1.384s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" released by "delete_snapshot" :: held 1.403s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Created reservations ['46f2e649-59f5-4631-bd33-3c1ff67d1529', '3e9c8336-84fc-4e35-a01e-d1288703e241', '051f2e2c-04a1-4b6f-8a37-4633cadc9558', '8c896c0a-d83f-4d71-8d4c-47a96428fde6'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:57 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Delete snapshot completed successfully.
Sep 29 16:51:57 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-9c59496c-e24b-4667-aae7-9f7fba775b52 tempest-ProjectMemberTests-510067890 None] Lock "cinder-64e2f192-d9b1-4866-bbdd-7b626b99cbfa-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-d1407c0f-c5ca-4033-a400-9e6e036d32c3-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "cinder-d1407c0f-c5ca-4033-a400-9e6e036d32c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Acquiring lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" acquired by "delete_volume" :: waited 0.013s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb5d46-28aa-4ae6-a4a9-e7f29139ec1c]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:51:58 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:58 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3
Sep 29 16:51:58 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:59 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3" returned: 0 in 0.351s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:59 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3
Sep 29 16:51:59 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:59 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-d1407c0f-c5ca-4033-a400-9e6e036d32c3" returned: 0 in 0.249s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "cinder-quobyte-d1407c0f-c5ca-4033-a400-9e6e036d32c3" released by "delete_volume" :: held 0.658s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Created reservations ['80121b7d-c45a-4e8e-a9d7-63604d65e42a', '6b3b9a12-c4c7-45b3-a117-6b1afc82052f', 'b5c46648-20a3-4cdc-8ed9-6a4b35f14318', '83db5c06-5acd-40cd-a19b-8f6f8ac61d30'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:51:59 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:51:59 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:51:59 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.238s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:51:59 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Deleted volume successfully.
Sep 29 16:51:59 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-edcd84d6-14f7-425b-bc57-d12f7b71c25b tempest-ProjectMemberTests-510067890 None] Lock "cinder-d1407c0f-c5ca-4033-a400-9e6e036d32c3-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (5cc86d74-8474-4899-aaeb-27492d9271f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed62e3c3-2a5d-4a5e-b52d-617ceb6c6f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed62e3c3-2a5d-4a5e-b52d-617ceb6c6f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695673280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83494182-9ac4-49f8-aa7e-4eabe6059fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:03Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954e71a5-d2c9-4eb5-88ab-efbdfae67d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954e71a5-d2c9-4eb5-88ab-efbdfae67d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f116a010-95f2-4118-ae93-f24aaa218b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f116a010-95f2-4118-ae93-f24aaa218b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83494182-9ac4-49f8-aa7e-4eabe6059fa9', 'volume_name': 'volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdcbc55-0c35-45b3-9f63-3e79abf4d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdcbc55-0c35-45b3-9f63-3e79abf4d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490eb550-7e98-426b-9419-458d0f506d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Volume 83494182-9ac4-49f8-aa7e-4eabe6059fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9', 'volume_size': 1}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695673280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83494182-9ac4-49f8-aa7e-4eabe6059fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:03Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Creating volume 83494182-9ac4-49f8-aa7e-4eabe6059fa9 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:52:03 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:03 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 1073741824
Sep 29 16:52:03 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:03 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 1073741824" returned: 0 in 0.416s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:03 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9
Sep 29 16:52:03 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:03 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9" returned: 0 in 0.240s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490eb550-7e98-426b-9419-458d0f506d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904f7592-27b3-45e6-bdf5-030a517e5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:03 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Volume volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 (83494182-9ac4-49f8-aa7e-4eabe6059fa9): created successfully
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904f7592-27b3-45e6-bdf5-030a517e5349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:03 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (5cc86d74-8474-4899-aaeb-27492d9271f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:03 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-3967000d-0b12-4ff2-accb-6980148525e8 tempest-ProjectReaderTests-488536062 None] Created volume successfully.
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-83494182-9ac4-49f8-aa7e-4eabe6059fa9-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "cinder-83494182-9ac4-49f8-aa7e-4eabe6059fa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-quobyte-83494182-9ac4-49f8-aa7e-4eabe6059fa9" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-83494182-9ac4-49f8-aa7e-4eabe6059fa9" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a9cf82-f49d-4764-8715-87de0a463b10]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:04 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9
Sep 29 16:52:04 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:04 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:04 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9
Sep 29 16:52:04 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:04 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:04 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-83494182-9ac4-49f8-aa7e-4eabe6059fa9" returned: 0 in 0.241s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-83494182-9ac4-49f8-aa7e-4eabe6059fa9" released by "delete_volume" :: held 0.641s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Created reservations ['e36be396-7045-419b-acd2-a3a7c3003e6e', 'c52a03a6-5988-4963-9bdf-0da14fee79fa', 'b8bb762c-8eb1-4e9a-b31a-4c80a1eaf5ca', 'd5dd3769-bd80-4aea-a413-dd595ee750fb'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:05 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:52:05 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:05 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.246s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:52:05 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Deleted volume successfully.
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-f539fa84-0662-47bf-bfd2-b4de7f47ddb6 tempest-ProjectReaderTests-488536062 None] Lock "cinder-83494182-9ac4-49f8-aa7e-4eabe6059fa9-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (40d7d2ee-7327-442f-acbc-32c19136323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8283f2-e541-471c-8b06-ab4cd14c8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8283f2-e541-471c-8b06-ab4cd14c8de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302317095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e159b-781b-49fa-83d9-66e6be67893d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:06Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d580694e-4454-42ef-a6d3-5b6abdf80cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d580694e-4454-42ef-a6d3-5b6abdf80cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895f6493-5a66-4fa9-b76f-57b650fa8ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895f6493-5a66-4fa9-b76f-57b650fa8ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9e159b-781b-49fa-83d9-66e6be67893d', 'volume_name': 'volume-2e9e159b-781b-49fa-83d9-66e6be67893d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c169d3-8ad6-4bb8-bbb5-4a7793bf7112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c169d3-8ad6-4bb8-bbb5-4a7793bf7112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb7e601-c2bd-4ef1-9c20-191eeb83cee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:05 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Volume 2e9e159b-781b-49fa-83d9-66e6be67893d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9e159b-781b-49fa-83d9-66e6be67893d', 'volume_size': 1}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302317095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e159b-781b-49fa-83d9-66e6be67893d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:06Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Creating volume 2e9e159b-781b-49fa-83d9-66e6be67893d {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:52:05 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:52:05 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:05 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d 1073741824
Sep 29 16:52:05 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:06 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d 1073741824" returned: 0 in 0.408s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:06 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d
Sep 29 16:52:06 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:06 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb7e601-c2bd-4ef1-9c20-191eeb83cee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9e159b-781b-49fa-83d9-66e6be67893d', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e9aef3-be86-40db-878a-7a39e12e007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:06 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Volume volume-2e9e159b-781b-49fa-83d9-66e6be67893d (2e9e159b-781b-49fa-83d9-66e6be67893d): created successfully
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e9aef3-be86-40db-878a-7a39e12e007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (40d7d2ee-7327-442f-acbc-32c19136323c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:06 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-45619188-a289-4b88-855d-ff79f779e9ab tempest-ProjectReaderTests-488536062 None] Created volume successfully.
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-2e9e159b-781b-49fa-83d9-66e6be67893d-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "cinder-2e9e159b-781b-49fa-83d9-66e6be67893d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-quobyte-2e9e159b-781b-49fa-83d9-66e6be67893d" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:06 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-2e9e159b-781b-49fa-83d9-66e6be67893d" acquired by "delete_volume" :: waited 0.015s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[f462a430-bc90-4684-9c8b-5652da044977]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:07 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d
Sep 29 16:52:07 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:07 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:07 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d
Sep 29 16:52:07 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:07 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-2e9e159b-781b-49fa-83d9-66e6be67893d" returned: 0 in 0.269s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-2e9e159b-781b-49fa-83d9-66e6be67893d" released by "delete_volume" :: held 0.670s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Created reservations ['367b0fe7-d13d-4a93-889a-914f336ff0d9', '21d6c26a-fc1b-4f54-ac4a-c7a82679136e', 'df1acaef-d2e9-49c8-a84d-e2215c88b1c1', '9c7d9aca-4895-432b-ab5e-b40f7d712207'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:07 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:52:07 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:08 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.239s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:52:08 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Deleted volume successfully.
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-177c0cf4-c628-4089-af44-eb219499144b tempest-ProjectReaderTests-488536062 None] Lock "cinder-2e9e159b-781b-49fa-83d9-66e6be67893d-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (4df0501f-a2cb-48a9-8e20-64c48713b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c042d0fd-6bed-4e84-8ef2-6ff118947b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c042d0fd-6bed-4e84-8ef2-6ff118947b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674165137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45903cb2-8a08-4306-9a79-ccda73224c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:08Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2a60d3-f461-4ffe-b686-fdf9a4d2b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2a60d3-f461-4ffe-b686-fdf9a4d2b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0ec0f9-d764-40d5-b00d-56579aecf92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0ec0f9-d764-40d5-b00d-56579aecf92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45903cb2-8a08-4306-9a79-ccda73224c98', 'volume_name': 'volume-45903cb2-8a08-4306-9a79-ccda73224c98', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72da580a-f525-47e6-98b0-80c0dc970aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72da580a-f525-47e6-98b0-80c0dc970aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab09fcc-eb03-48b3-80c7-6f217d46ce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:08 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Volume 45903cb2-8a08-4306-9a79-ccda73224c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45903cb2-8a08-4306-9a79-ccda73224c98', 'volume_size': 1}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674165137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45903cb2-8a08-4306-9a79-ccda73224c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:08Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Creating volume 45903cb2-8a08-4306-9a79-ccda73224c98 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:52:08 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:08 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 1073741824
Sep 29 16:52:08 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:08 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:08 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 1073741824" returned: 0 in 0.397s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:09 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98
Sep 29 16:52:09 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:09 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab09fcc-eb03-48b3-80c7-6f217d46ce77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45903cb2-8a08-4306-9a79-ccda73224c98', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9fe3ca-fb9d-4b7a-b4cf-ef9392a3d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:09 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Volume volume-45903cb2-8a08-4306-9a79-ccda73224c98 (45903cb2-8a08-4306-9a79-ccda73224c98): created successfully
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9fe3ca-fb9d-4b7a-b4cf-ef9392a3d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (4df0501f-a2cb-48a9-8e20-64c48713b29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-52f50b00-d7f1-4088-99d4-e62ccd3409d4 tempest-ProjectReaderTests-488536062 None] Created volume successfully.
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-45903cb2-8a08-4306-9a79-ccda73224c98-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "cinder-45903cb2-8a08-4306-9a79-ccda73224c98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-quobyte-45903cb2-8a08-4306-9a79-ccda73224c98" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-45903cb2-8a08-4306-9a79-ccda73224c98" acquired by "delete_volume" :: waited 0.014s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3a5b2-404f-48ed-a454-86c84fc0219e]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:52:09 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:09 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98
Sep 29 16:52:09 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:10 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98" returned: 0 in 0.370s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:10 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98
Sep 29 16:52:10 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:10 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-45903cb2-8a08-4306-9a79-ccda73224c98" returned: 0 in 0.247s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-45903cb2-8a08-4306-9a79-ccda73224c98" released by "delete_volume" :: held 0.655s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Created reservations ['9f7d55a5-eefa-4951-938d-3f288dc03e4c', '8de40a7d-22c6-4afb-b419-1713e515b8fa', '63142856-a3e5-4f44-b3f9-1b358d8ee5d1', '2c4479a1-3f04-4abd-8db3-bb56e008c20e'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:10 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:52:10 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:10 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:52:10 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Deleted volume successfully.
Sep 29 16:52:10 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-158b0201-6a28-444e-bf83-2a0511751c48 tempest-ProjectReaderTests-488536062 None] Lock "cinder-45903cb2-8a08-4306-9a79-ccda73224c98-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86843) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (6fbd4b5b-1faa-41af-8e49-3e5e3daa970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38563f7-bf54-4933-826a-539f3fe40eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38563f7-bf54-4933-826a-539f3fe40eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253173846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73c65c-8eb9-4afb-9e36-9a07e60d3412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:11Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09a51cb-10db-4033-906d-1ba14fc3ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09a51cb-10db-4033-906d-1ba14fc3ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bfb752-4e7a-47a7-bfcf-0b44d6d70547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bfb752-4e7a-47a7-bfcf-0b44d6d70547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b73c65c-8eb9-4afb-9e36-9a07e60d3412', 'volume_name': 'volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3808ed2-5a44-4cfe-9442-5842d8f8593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3808ed2-5a44-4cfe-9442-5842d8f8593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bd37fd-9b20-4132-ac3a-fcf32452bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Volume 8b73c65c-8eb9-4afb-9e36-9a07e60d3412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412', 'volume_size': 1}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7560f894bc20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253173846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73c65c-8eb9-4afb-9e36-9a07e60d3412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459dabf35d6544d0bf6e6d72f7a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:11Z,use_quota=True,user_id='8d3b33e7d6e948be9c6d6f4353356f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c4a7f1-f385-4a42-b2f1-86c1b78ea711),volume_type_id=47c4a7f1-f385-4a42-b2f1-86c1b78ea711)}" {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.remotefs [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Creating volume 8b73c65c-8eb9-4afb-9e36-9a07e60d3412 {{(pid=86843) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Selected osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17 as target Quobyte volume. {{(pid=86843) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 16:52:11 devstack cinder-volume[86843]: INFO cinder.volume.drivers.remotefs [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] casted to osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 1073741824 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:11 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 1073741824
Sep 29 16:52:11 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:11 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 1073741824" returned: 0 in 0.395s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:11 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412
Sep 29 16:52:11 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:11 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" returned: 0 in 0.253s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'} {{(pid=86843) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bd37fd-9b20-4132-ac3a-fcf32452bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412', 'volume_size': 1}' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5700110d-d684-4b44-99aa-e7f362b879c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 16:52:11 devstack cinder-volume[86843]: INFO cinder.volume.flows.manager.create_volume [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Volume volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 (8b73c65c-8eb9-4afb-9e36-9a07e60d3412): created successfully
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5700110d-d684-4b44-99aa-e7f362b879c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86843) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 16:52:11 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Flow 'volume_create_manager' (6fbd4b5b-1faa-41af-8e49-3e5e3daa970e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86843) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 16:52:11 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-05e3a4bb-2e66-43de-b3d5-54c15c96b8a8 tempest-ProjectReaderTests-488536062 None] Created volume successfully.
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-8b73c65c-8eb9-4afb-9e36-9a07e60d3412-delete_volume" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "cinder-8b73c65c-8eb9-4afb-9e36-9a07e60d3412-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "cinder-quobyte-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" by "delete_volume" {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" acquired by "delete_volume" :: waited 0.016s {{(pid=86843) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a5750-6c1e-4b0f-93ce-7405f4644549]: (4, 'qcow2') {{(pid=88505) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:12 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412
Sep 29 16:52:12 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:12 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" returned: 0 in 0.363s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:12 devstack sudo[108112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412
Sep 29 16:52:12 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:12 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2/volume-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" returned: 0 in 0.242s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "cinder-quobyte-8b73c65c-8eb9-4afb-9e36-9a07e60d3412" released by "delete_volume" :: held 0.642s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.quota [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Created reservations ['290e5272-8b1b-45a8-b5ca-1e780da9c799', 'ac433194-44ec-4a45-8dc5-6904c01855da', '12905932-e216-449d-aa31-826b7b53260d', 'fbe393b5-a561-4705-9dfb-a87e1b997262'] {{(pid=86843) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17': None} {{(pid=86843) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG cinder.volume.drivers.quobyte [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7fffc578-b180-4add-bb33-b9cb574a7e17'] {{(pid=86843) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86843) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 16:52:12 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2 {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 16:52:13 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2
Sep 29 16:52:13 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 16:52:13 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Sep 29 16:52:13 devstack cinder-volume[86843]: DEBUG oslo_concurrency.processutils [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7da6b05085452b51c8c286179a32f2c2" returned: 0 in 0.246s {{(pid=86843) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 16:52:13 devstack cinder-volume[86843]: DEBUG cinder.manager [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Notifying Schedulers of capabilities ... {{(pid=86843) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 16:52:13 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Deleted volume successfully.
Sep 29 16:52:13 devstack cinder-volume[86843]: DEBUG cinder.coordination [None req-c686c689-6c26-4d55-b7c3-18bee24cc0c8 tempest-ProjectReaderTests-488536062 None] Lock "cinder-8b73c65c-8eb9-4afb-9e36-9a07e60d3412-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86843) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 16:52:22 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=147,cinder:SELECT=110,cinder:INSERT=39,cinder:DELETE=11 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 16:52:23 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:UPDATE=151,cinder:DELETE=14,cinder:SELECT=101,cinder:INSERT=38 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}